2019-12-24T21:20:43.871 INFO:root:teuthology version: 1.0.0-ebb2eff 2019-12-24T21:20:43.871 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.PivWw7.tmp -- --verbose --lock --description rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/careful.yaml thrashosds-health.yaml workloads/radosbench.yaml} --name sage-2019-12-24_21:11:08-rados:thrash-old-clients-wip-sage-testing-2019-12-23-1810-distro-basic-smithi --block --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2019-12-24_21:11:08-rados:thrash-old-clients-wip-sage-testing-2019-12-23-1810-distro-basic-smithi/4630506 2019-12-24T21:20:43.955 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-24T21:20:44.014 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2019-12-24_21:11:08-rados:thrash-old-clients-wip-sage-testing-2019-12-23-1810-distro-basic-smithi/4630506 branch: wip-sage-testing-2019-12-23-1810 description: rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/careful.yaml thrashosds-health.yaml workloads/radosbench.yaml} email: null first_in_suite: false job_id: '4630506' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: sage-2019-12-24_21:11:08-rados:thrash-old-clients-wip-sage-testing-2019-12-23-1810-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - volumes: count: 4 size: 10 os_type: centos os_version: '7.6' overrides: admin_socket: branch: wip-sage-testing-2019-12-23-1810 ceph: conf: client.2: debug ms: 1 debug objecter: 20 debug rados: 20 global: mon client directed command retry: 5 ms inject socket failures: 2500 ms tcp read timeout: 5 osd_pool_default_min_size: 2 osd_pool_default_size: 3 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 osd debug reject backfill probability: 0.3 osd debug verify cached snaps: true osd debug verify missing on start: true osd max backfills: 3 osd op queue: debug_random osd op queue cut off: debug_random osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MON_DOWN\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow requests sha1: 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 thrashosds: min_in: 4 workunit: branch: wip-cephadm-cot sha1: ae3ed51e14ccef082d0470205ec570125f0f3d4f owner: scheduled_sage@teuthology priority: 30 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - - mon.c - osd.8 - osd.9 - osd.10 - osd.11 - client.2 sha1: 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 suite: rados:thrash-old-clients suite_branch: wip-cephadm-cot suite_path: /home/teuthworker/src/github.com_liewegas_ceph_wip-cephadm-cot/qa suite_relpath: qa suite_repo: https://github.com/liewegas/ceph suite_sha1: ae3ed51e14ccef082d0470205ec570125f0f3d4f tasks: - install: branch: nautilus exclude_packages: - cephadm - ceph-mgr-cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs extra_packages: - python-rados - python-rgw - python-rbd - python-cephfs - cephadm: null - thrashosds: aggressive_pg_num_changes: false chance_pgnum_grow: 1 chance_pgpnum_fix: 1 timeout: 1200 - full_sequential: - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.2505 2019-12-24T21:20:44.014 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_liewegas_ceph_wip-cephadm-cot/qa; will attempt to use it 2019-12-24T21:20:44.015 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_liewegas_ceph_wip-cephadm-cot/qa/tasks 2019-12-24T21:20:44.015 INFO:teuthology.run_tasks:Running task internal.check_packages... 2019-12-24T21:20:44.017 INFO:teuthology.task.internal:Checking packages... 2019-12-24T21:20:44.030 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01' 2019-12-24T21:20:44.030 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-24T21:20:44.031 INFO:teuthology.packaging:ref: None 2019-12-24T21:20:44.031 INFO:teuthology.packaging:tag: None 2019-12-24T21:20:44.031 INFO:teuthology.packaging:branch: wip-sage-testing-2019-12-23-1810 2019-12-24T21:20:44.031 INFO:teuthology.packaging:sha1: 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 2019-12-24T21:20:44.031 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-sage-testing-2019-12-23-1810 2019-12-24T21:20:44.185 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-8840.g7b0bf18 2019-12-24T21:20:44.185 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2019-12-24T21:20:44.197 INFO:teuthology.task.internal:no buildpackages task found 2019-12-24T21:20:44.197 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2019-12-24T21:20:44.225 INFO:teuthology.task.internal.lock_machines:Locking machines... 2019-12-24T21:20:44.225 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-24T21:20:44.267 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:20:54.284 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:21:04.303 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:21:14.321 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:21:24.338 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:21:34.353 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:21:44.370 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:21:54.384 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:22:04.400 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:22:14.417 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:22:24.443 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:22:34.461 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:22:44.476 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:22:54.484 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:23:04.499 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:23:14.516 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:23:24.524 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:23:34.540 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:23:44.550 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:23:54.564 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:24:04.582 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:24:14.597 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:24:24.614 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:24:34.632 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:24:44.647 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:24:54.663 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:25:04.680 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:25:14.696 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:25:24.712 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:25:34.728 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:25:44.745 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:25:54.762 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:26:04.776 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:26:14.791 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:26:24.802 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:26:34.816 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:26:44.836 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:26:54.853 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:27:04.873 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:27:14.894 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:27:24.913 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:27:34.930 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:27:44.944 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:27:54.960 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:28:04.978 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:28:14.997 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:28:25.012 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:28:35.028 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:28:45.045 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:28:55.062 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:29:05.080 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:29:15.092 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:29:25.103 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:29:35.121 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:29:45.138 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:29:55.153 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:30:05.168 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:30:15.181 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:30:25.197 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:30:35.213 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:30:45.230 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:30:55.247 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:31:05.264 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:31:15.283 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:31:25.297 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:31:35.310 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:31:45.321 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:31:55.331 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:32:05.344 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:32:15.362 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:32:25.376 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:32:35.393 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:32:45.408 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:32:55.425 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:33:05.441 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:33:15.456 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:33:25.473 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:33:35.491 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:33:45.508 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:33:55.522 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:34:05.536 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:34:15.552 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:34:25.568 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:34:35.585 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:34:45.603 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:34:55.621 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:35:05.638 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:35:15.652 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:35:25.668 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:35:35.684 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:35:45.700 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:35:55.719 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:36:05.737 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:36:15.754 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:36:25.767 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:36:35.785 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:36:45.800 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:36:55.816 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:37:05.839 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:37:15.858 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:37:25.873 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:37:35.888 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:37:45.904 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:37:55.921 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:38:05.936 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:38:15.952 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:38:25.968 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:38:35.979 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:38:45.996 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:38:56.012 DEBUG:teuthology.lock.ops:lock_many request: {'count': 3, 'locked_by': 'scheduled_sage@teuthology', 'description': '/home/teuthworker/archive/sage-2019-12-24_21:11:08-rados:thrash-old-clients-wip-sage-testing-2019-12-23-1810-distro-basic-smithi/4630506', 'machine_type': 'smithi'} 2019-12-24T21:38:56.032 DEBUG:teuthology.lock.ops:locked ubuntu@smithi037.front.sepia.ceph.com, ubuntu@smithi124.front.sepia.ceph.com, ubuntu@smithi006.front.sepia.ceph.com 2019-12-24T21:38:56.133 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-12-24T21:38:56.332 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of centos 7.6 2019-12-24T21:38:56.336 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of centos 7.6 2019-12-24T21:38:56.344 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of centos 7.6 2019-12-24T21:38:56.653 INFO:teuthology.orchestra.console:Power off smithi037 2019-12-24T21:38:56.653 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-24T21:38:56.671 INFO:teuthology.orchestra.console:Power off smithi124 2019-12-24T21:38:56.671 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-24T21:38:56.690 INFO:teuthology.orchestra.console:Power off smithi006 2019-12-24T21:38:56.690 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-24T21:38:56.698 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T21:38:56.706 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T21:38:56.716 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T21:39:00.726 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T21:39:00.737 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T21:39:00.751 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T21:39:04.843 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T21:39:04.853 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T21:39:04.864 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T21:39:08.958 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T21:39:08.969 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T21:39:08.977 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T21:39:09.170 INFO:teuthology.orchestra.console:Power off for smithi124 completed 2019-12-24T21:39:09.179 INFO:teuthology.orchestra.console:Power off for smithi037 completed 2019-12-24T21:39:09.188 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2019-12-24T21:39:09.271 INFO:teuthology.orchestra.console:Power on smithi124 2019-12-24T21:39:09.272 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-24T21:39:09.282 INFO:teuthology.orchestra.console:Power on smithi037 2019-12-24T21:39:09.283 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-24T21:39:09.292 INFO:teuthology.orchestra.console:Power on smithi006 2019-12-24T21:39:09.293 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-24T21:39:09.301 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T21:39:09.312 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T21:39:09.324 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T21:39:13.336 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T21:39:13.345 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T21:39:13.353 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T21:39:13.548 INFO:teuthology.orchestra.console:Power on for smithi037 completed 2019-12-24T21:39:13.562 INFO:teuthology.orchestra.console:Power on for smithi006 completed 2019-12-24T21:39:13.649 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish 2019-12-24T21:39:13.663 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2019-12-24T21:39:17.456 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T21:39:17.667 INFO:teuthology.orchestra.console:Power on for smithi124 completed 2019-12-24T21:39:17.768 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2019-12-24T21:41:29.635 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi006.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:41:38.705 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi006.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:41:44.749 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi037.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:41:47.786 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi006.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:41:53.803 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi037.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:41:56.847 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi006.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:42:02.857 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi037.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:42:03.917 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi124.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:42:05.898 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi006.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:42:11.914 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi037.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:42:12.970 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi124.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:42:14.958 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi006.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:42:20.973 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi037.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:42:22.026 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi124.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:42:30.029 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi037.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:42:31.082 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi124.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:42:40.145 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi124.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:42:49.233 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi124.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:42:58.317 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi124.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:43:07.378 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi124.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:43:16.458 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi124.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:43:20.962 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi006.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:43:21.189 INFO:teuthology.orchestra.run.smithi006:> hostname 2019-12-24T21:43:21.730 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2019-12-24T21:43:21.731 INFO:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts 2019-12-24T21:43:21.814 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2019-12-24T21:43:21.815 INFO:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2019-12-24T21:43:21.956 INFO:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts 2019-12-24T21:43:22.064 INFO:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts 2019-12-24T21:43:22.154 INFO:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname 2019-12-24T21:43:22.230 INFO:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2019-12-24T21:43:22.306 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2019-12-24T21:43:22.308 DEBUG:teuthology.parallel:result is None 2019-12-24T21:43:36.038 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi037.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:43:36.260 INFO:teuthology.orchestra.run.smithi037:> hostname 2019-12-24T21:43:36.847 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com 2019-12-24T21:43:36.847 INFO:teuthology.orchestra.run.smithi037:> grep smithi037.front.sepia.ceph.com /etc/hosts 2019-12-24T21:43:36.926 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037 2019-12-24T21:43:36.926 INFO:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2019-12-24T21:43:37.086 INFO:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hosts 2019-12-24T21:43:37.202 INFO:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/172.21.15.37/172.21.15.37/g' /etc/hosts 2019-12-24T21:43:37.302 INFO:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hostname 2019-12-24T21:43:37.407 INFO:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2019-12-24T21:43:37.491 INFO:teuthology.provision.fog.smithi037:Deploy complete! 2019-12-24T21:43:37.493 DEBUG:teuthology.parallel:result is None 2019-12-24T21:43:53.901 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi124.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:43:54.116 INFO:teuthology.orchestra.run.smithi124:> hostname 2019-12-24T21:43:54.613 INFO:teuthology.orchestra.run.smithi124.stdout:smithi068 2019-12-24T21:43:54.613 INFO:teuthology.orchestra.run.smithi124:> grep smithi068 /etc/hosts 2019-12-24T21:43:54.660 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.68 smithi068.front.sepia.ceph.com smithi068 2019-12-24T21:43:54.660 INFO:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2019-12-24T21:43:54.843 INFO:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi068/smithi124/g' /etc/hosts 2019-12-24T21:43:54.920 INFO:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.68/172.21.15.124/g' /etc/hosts 2019-12-24T21:43:54.990 INFO:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi068/smithi124/g' /etc/hostname 2019-12-24T21:43:55.053 INFO:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2019-12-24T21:43:55.104 INFO:teuthology.provision.fog.smithi124:Deploy complete! 2019-12-24T21:43:55.106 DEBUG:teuthology.parallel:result is None 2019-12-24T21:43:55.329 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com 2019-12-24T21:43:55.330 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-24T21:43:55.345 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2019-12-24T21:43:55.345 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-24T21:43:55.355 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com 2019-12-24T21:43:55.355 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-24T21:43:55.368 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server 2019-12-24T21:43:55.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-24T21:43:55.369 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi037.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:43:55.469 INFO:teuthology.orchestra.run.smithi037:> true 2019-12-24T21:43:55.838 INFO:teuthology.orchestra.run.smithi037:> uname -m 2019-12-24T21:43:55.894 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2019-12-24T21:43:55.895 INFO:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2019-12-24T21:43:55.953 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Linux" 2019-12-24T21:43:55.953 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="7 (Core)" 2019-12-24T21:43:55.953 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2019-12-24T21:43:55.953 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2019-12-24T21:43:55.953 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="7" 2019-12-24T21:43:55.954 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-24T21:43:55.954 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2019-12-24T21:43:55.954 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-24T21:43:55.954 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.centos.org/" 2019-12-24T21:43:55.954 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-24T21:43:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:43:55.954 INFO:teuthology.orchestra.run.smithi037.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-24T21:43:55.955 INFO:teuthology.orchestra.run.smithi037.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-24T21:43:55.955 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-24T21:43:55.955 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-24T21:43:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:43:55.956 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2019-12-24T21:43:55.969 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2019-12-24T21:43:55.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-24T21:43:55.970 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi006.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:43:56.068 INFO:teuthology.orchestra.run.smithi006:> true 2019-12-24T21:43:56.479 INFO:teuthology.orchestra.run.smithi006:> uname -m 2019-12-24T21:43:56.565 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2019-12-24T21:43:56.566 INFO:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2019-12-24T21:43:56.644 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Linux" 2019-12-24T21:43:56.644 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="7 (Core)" 2019-12-24T21:43:56.644 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2019-12-24T21:43:56.644 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2019-12-24T21:43:56.644 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="7" 2019-12-24T21:43:56.644 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-24T21:43:56.645 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2019-12-24T21:43:56.645 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-24T21:43:56.645 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.centos.org/" 2019-12-24T21:43:56.645 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-24T21:43:56.645 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:43:56.645 INFO:teuthology.orchestra.run.smithi006.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-24T21:43:56.645 INFO:teuthology.orchestra.run.smithi006.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-24T21:43:56.646 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-24T21:43:56.646 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-24T21:43:56.646 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:43:56.646 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2019-12-24T21:43:56.661 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server 2019-12-24T21:43:56.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-24T21:43:56.662 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi124.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:43:56.755 INFO:teuthology.orchestra.run.smithi124:> true 2019-12-24T21:43:57.080 INFO:teuthology.orchestra.run.smithi124:> uname -m 2019-12-24T21:43:57.125 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2019-12-24T21:43:57.126 INFO:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2019-12-24T21:43:57.167 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Linux" 2019-12-24T21:43:57.167 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="7 (Core)" 2019-12-24T21:43:57.167 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos" 2019-12-24T21:43:57.167 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora" 2019-12-24T21:43:57.168 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="7" 2019-12-24T21:43:57.168 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-24T21:43:57.168 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2019-12-24T21:43:57.168 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-24T21:43:57.168 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.centos.org/" 2019-12-24T21:43:57.168 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-24T21:43:57.168 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:43:57.169 INFO:teuthology.orchestra.run.smithi124.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-24T21:43:57.169 INFO:teuthology.orchestra.run.smithi124.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-24T21:43:57.169 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-24T21:43:57.169 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-24T21:43:57.169 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:43:57.170 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2019-12-24T21:43:57.187 INFO:teuthology.task.internal.lock_machines:3 smithi machines locked this try, 3/3 locked so far 2019-12-24T21:43:57.227 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi006.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCglZ3HF/P00V+mmJZLT+S4g6Dye1RnaQ53cCKrrHdOseqbPuLsuVfCyTAl1vvHAY5RqxaOw23ztou6EUeuKD9NIbJtJmRvS7rp7rqieCtSKLCtSyg0JT3EMUYRjkVo9l/wFydaOMq8GWGL1hkYQ6xZWG20Lg7a0oaBeJGaiY4JxzNeKCXotN8bFlQLtux3XjASbDxgEsy2A7HZF5eeh3H/IJSA/bR+te/0sgnqDeA8gXxrxoGOAS02Djp7x8xpmafP5+nT0qqg44OcM2bE8Jievg1KFhP1nGNZAqdXrskRERIR7i3cVqpnXpgpSGn1px97WN7Nm0tBWDSfzv6Wd5e1 smithi037.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDscxzC+2tZ4U6pl9sQSf11Lf2kghC9dMdCcVBmOHnxXfuziAsADompzUAHGURPsLQbVtU5Jx+f3DJtCWhivrZDywMN0vNGLHd1N0Tg8GdSqAI0swewleb3oIWhlPHQMwPwtNdyU5kOsQ6qhDxLC//f5L9W/Kknw4/8fjJmZlFxHB8hOGpPskR4m8W4QM3SWFq5heWNt6JnI8h8pZO6T00yptpKpKvuwF4TAWD4Sj9QWWoBk+gUreurKabqeVVJj11eymmFsV7B7ZFs6r6hITc5/ARxWhYEktqNNeKqheL3jsFJv8NEg/w7XykpxWxMQmAqJKfgG3l4X8hERJZvIXOl smithi124.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDWPKeXww3PG7+eCBzRgdLVD3YlNN8r+k2Sg7Ec/eh28w4lSNkS0fzTCd3JW4NBlHJYq7xX7miat2JGhDWtISIKJtL93RHFWRfBRneS0iqghyqcS3yGTrXZnN6gK18Om8YchvI9ukBUtjhx4IKveiXG71rh+uyn+CrfVYIpAuYNsBUJDHeG+5Atc+xUZo4CHuX/iwZk4jJM+AtKCvx08D+9k/xTvjP3s3CA/gRkYd69nx6sGESssf4EWYIkh1CXXPSrJCAgTEqqI4Cr52e83PVC20r6cikfyrZvDPmCUtAzp73OsJYFR3TLrEV15s+mnMqpsl+u5JfFvPw0BjNnWTQF 2019-12-24T21:43:57.227 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-24T21:43:57.275 INFO:teuthology.run_tasks:Running task internal.save_config... 2019-12-24T21:43:57.285 INFO:teuthology.task.internal:Saving configuration 2019-12-24T21:43:57.303 INFO:teuthology.run_tasks:Running task internal.check_lock... 2019-12-24T21:43:57.314 INFO:teuthology.task.internal.check_lock:Checking locks... 2019-12-24T21:43:57.328 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-24 21:38:56.019163', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi037.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEtBMyCaGeaa7qCseE/yRUpv1EjumF4KLe57XoOFG2qjlw8C6AjHVwCOHwE8CBB1Vj5X3PnlMyc6Sdakm5g2djI=', u'description': u'/home/teuthworker/archive/sage-2019-12-24_21:11:08-rados:thrash-old-clients-wip-sage-testing-2019-12-23-1810-distro-basic-smithi/4630506'} 2019-12-24T21:43:57.341 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-24 21:38:56.019183', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi006.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDI/g6kS+pt2hVncSDDlM/Ek7s2uprNufwj+L765w5e+N3DQ3JR0gxhSf6eS1Iyafkspz7a7b69o2lKtMWFt2eg=', u'description': u'/home/teuthworker/archive/sage-2019-12-24_21:11:08-rados:thrash-old-clients-wip-sage-testing-2019-12-23-1810-distro-basic-smithi/4630506'} 2019-12-24T21:43:57.353 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-24 21:38:56.019199', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi124.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMYoha/yTRPaHg0LmjaCMGN33QwPT0iUEOvyNFjXtgL4tELzEzuLX20ICjHvCn2dE8WtiAXSLXkBcO3jeyolaIk=', u'description': u'/home/teuthworker/archive/sage-2019-12-24_21:11:08-rados:thrash-old-clients-wip-sage-testing-2019-12-23-1810-distro-basic-smithi/4630506'} 2019-12-24T21:43:57.353 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2019-12-24T21:43:57.404 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-12-24T21:43:57.404 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-12-24T21:43:57.404 INFO:teuthology.task.internal:roles: ubuntu@smithi124.front.sepia.ceph.com - ['mon.c', 'osd.8', 'osd.9', 'osd.10', 'osd.11', 'client.2'] 2019-12-24T21:43:57.404 INFO:teuthology.run_tasks:Running task console_log... 2019-12-24T21:43:57.507 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-12-24T21:43:57.508 INFO:teuthology.run_tasks:Running task internal.connect... 2019-12-24T21:43:57.524 INFO:teuthology.task.internal:Opening connections... 2019-12-24T21:43:57.524 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2019-12-24T21:43:57.526 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi006.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:43:57.640 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2019-12-24T21:43:57.641 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi037.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:43:57.749 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi124.front.sepia.ceph.com 2019-12-24T21:43:57.750 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi124.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:43:57.827 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2019-12-24T21:43:57.839 INFO:teuthology.orchestra.run.smithi006:> uname -m 2019-12-24T21:43:57.972 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2019-12-24T21:43:57.973 INFO:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2019-12-24T21:43:58.038 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Linux" 2019-12-24T21:43:58.039 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="7 (Core)" 2019-12-24T21:43:58.039 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2019-12-24T21:43:58.039 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2019-12-24T21:43:58.039 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="7" 2019-12-24T21:43:58.039 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-24T21:43:58.039 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2019-12-24T21:43:58.040 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-24T21:43:58.040 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.centos.org/" 2019-12-24T21:43:58.040 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-24T21:43:58.040 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:43:58.040 INFO:teuthology.orchestra.run.smithi006.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-24T21:43:58.040 INFO:teuthology.orchestra.run.smithi006.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-24T21:43:58.041 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-24T21:43:58.041 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-24T21:43:58.041 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:43:58.041 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2019-12-24T21:43:58.066 INFO:teuthology.orchestra.run.smithi037:> uname -m 2019-12-24T21:43:58.191 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2019-12-24T21:43:58.192 INFO:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2019-12-24T21:43:58.269 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Linux" 2019-12-24T21:43:58.269 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="7 (Core)" 2019-12-24T21:43:58.269 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2019-12-24T21:43:58.271 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2019-12-24T21:43:58.272 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="7" 2019-12-24T21:43:58.272 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-24T21:43:58.272 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2019-12-24T21:43:58.273 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-24T21:43:58.273 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.centos.org/" 2019-12-24T21:43:58.274 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-24T21:43:58.274 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:43:58.274 INFO:teuthology.orchestra.run.smithi037.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-24T21:43:58.274 INFO:teuthology.orchestra.run.smithi037.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-24T21:43:58.274 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-24T21:43:58.274 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-24T21:43:58.274 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:43:58.275 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2019-12-24T21:43:58.288 INFO:teuthology.orchestra.run.smithi124:> uname -m 2019-12-24T21:43:58.350 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2019-12-24T21:43:58.351 INFO:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2019-12-24T21:43:58.388 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Linux" 2019-12-24T21:43:58.389 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="7 (Core)" 2019-12-24T21:43:58.389 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos" 2019-12-24T21:43:58.389 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora" 2019-12-24T21:43:58.389 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="7" 2019-12-24T21:43:58.390 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-24T21:43:58.390 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2019-12-24T21:43:58.390 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-24T21:43:58.390 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.centos.org/" 2019-12-24T21:43:58.390 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-24T21:43:58.390 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:43:58.390 INFO:teuthology.orchestra.run.smithi124.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-24T21:43:58.391 INFO:teuthology.orchestra.run.smithi124.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-24T21:43:58.391 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-24T21:43:58.391 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-24T21:43:58.391 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:43:58.391 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2019-12-24T21:43:58.404 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2019-12-24T21:43:58.448 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2019-12-24T21:43:58.458 INFO:teuthology.task.internal:Checking for old test directory... 2019-12-24T21:43:58.459 INFO:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2019-12-24T21:43:58.462 INFO:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2019-12-24T21:43:58.466 INFO:teuthology.orchestra.run.smithi124:> test '!' -e /home/ubuntu/cephtest 2019-12-24T21:43:58.549 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2019-12-24T21:43:58.559 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2019-12-24T21:43:58.560 INFO:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2019-12-24T21:43:58.563 INFO:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2019-12-24T21:43:58.567 INFO:teuthology.orchestra.run.smithi124:> test -z $(ls -A /var/lib/ceph) 2019-12-24T21:43:58.652 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2019-12-24T21:43:58.705 INFO:teuthology.run_tasks:Running task kernel... 2019-12-24T21:43:58.726 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'osd.8': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'osd.11': {'sha1': 'distro', 'kdb': True}, 'osd.10': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'osd.9': {'sha1': 'distro', 'kdb': True}, 'client.2': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}} 2019-12-24T21:43:58.726 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2019-12-24T21:43:58.734 INFO:teuthology.orchestra.run.smithi037:> uname -r 2019-12-24T21:43:58.818 INFO:teuthology.orchestra.run.smithi037.stdout:3.10.0-1062.4.1.el7.x86_64 2019-12-24T21:43:58.818 INFO:teuthology.task.kernel:Running kernel on smithi037: 3.10.0-1062.4.1.el7.x86_64 2019-12-24T21:43:58.818 INFO:teuthology.orchestra.run.smithi037:> sudo yum install -y kernel 2019-12-24T21:43:59.731 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:43:59.861 INFO:teuthology.orchestra.run.smithi037.stdout:Determining fastest mirrors 2019-12-24T21:44:00.378 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:44:00.388 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: ftp.linux.ncsu.edu 2019-12-24T21:44:00.389 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:44:00.389 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-12-24T21:44:03.283 INFO:teuthology.orchestra.run.smithi037.stdout:Resolving Dependencies 2019-12-24T21:44:03.283 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:44:03.283 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package kernel.x86_64 0:3.10.0-1062.9.1.el7 will be installed 2019-12-24T21:44:04.576 INFO:teuthology.orchestra.run.smithi037.stdout:--> Finished Dependency Resolution 2019-12-24T21:44:05.355 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:44:05.355 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies Resolved 2019-12-24T21:44:05.361 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:44:05.361 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:44:05.361 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2019-12-24T21:44:05.361 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:44:05.361 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2019-12-24T21:44:05.361 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 3.10.0-1062.9.1.el7 updates 50 M 2019-12-24T21:44:05.362 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:44:05.362 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2019-12-24T21:44:05.362 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:44:05.362 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2019-12-24T21:44:05.362 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:44:05.363 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 50 M 2019-12-24T21:44:05.363 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 64 M 2019-12-24T21:44:05.363 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading packages: 2019-12-24T21:44:05.370 INFO:teuthology.orchestra.run.smithi037.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-24T21:44:06.308 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2019-12-24T21:44:06.520 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2019-12-24T21:44:07.368 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded 2019-12-24T21:44:07.368 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2019-12-24T21:44:44.415 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-24T21:44:44.967 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-24T21:44:44.968 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:44:44.968 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2019-12-24T21:44:44.968 INFO:teuthology.orchestra.run.smithi037.stdout: kernel.x86_64 0:3.10.0-1062.9.1.el7 2019-12-24T21:44:44.969 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:44:44.969 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2019-12-24T21:44:45.039 INFO:teuthology.orchestra.run.smithi037:> rpm -q kernel --last | head -n 1 2019-12-24T21:44:45.453 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Tue 24 Dec 2019 09:44:10 PM UTC 2019-12-24T21:44:45.455 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:44:45.455 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:44:45.456 INFO:teuthology.orchestra.run.smithi124:> uname -r 2019-12-24T21:44:45.587 INFO:teuthology.orchestra.run.smithi124.stdout:3.10.0-1062.4.1.el7.x86_64 2019-12-24T21:44:45.587 INFO:teuthology.task.kernel:Running kernel on smithi124: 3.10.0-1062.4.1.el7.x86_64 2019-12-24T21:44:45.587 INFO:teuthology.orchestra.run.smithi124:> sudo yum install -y kernel 2019-12-24T21:44:46.467 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:44:46.598 INFO:teuthology.orchestra.run.smithi124.stdout:Determining fastest mirrors 2019-12-24T21:44:47.283 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:44:47.291 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: ftp.linux.ncsu.edu 2019-12-24T21:44:47.292 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:44:47.292 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-12-24T21:44:50.265 INFO:teuthology.orchestra.run.smithi124.stdout:Resolving Dependencies 2019-12-24T21:44:50.266 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:44:50.266 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package kernel.x86_64 0:3.10.0-1062.9.1.el7 will be installed 2019-12-24T21:44:51.517 INFO:teuthology.orchestra.run.smithi124.stdout:--> Finished Dependency Resolution 2019-12-24T21:44:52.427 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:44:52.427 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies Resolved 2019-12-24T21:44:52.435 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:44:52.435 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:44:52.435 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2019-12-24T21:44:52.435 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:44:52.435 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2019-12-24T21:44:52.435 INFO:teuthology.orchestra.run.smithi124.stdout: kernel x86_64 3.10.0-1062.9.1.el7 updates 50 M 2019-12-24T21:44:52.436 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:44:52.436 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2019-12-24T21:44:52.436 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:44:52.436 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package 2019-12-24T21:44:52.436 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:44:52.437 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 50 M 2019-12-24T21:44:52.437 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 64 M 2019-12-24T21:44:52.437 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading packages: 2019-12-24T21:44:52.445 INFO:teuthology.orchestra.run.smithi124.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-24T21:44:53.046 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2019-12-24T21:44:53.244 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2019-12-24T21:44:54.110 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded 2019-12-24T21:44:54.111 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2019-12-24T21:45:28.890 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-24T21:45:29.379 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-24T21:45:29.379 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:45:29.379 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2019-12-24T21:45:29.379 INFO:teuthology.orchestra.run.smithi124.stdout: kernel.x86_64 0:3.10.0-1062.9.1.el7 2019-12-24T21:45:29.379 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:45:29.380 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2019-12-24T21:45:29.433 INFO:teuthology.orchestra.run.smithi124:> rpm -q kernel --last | head -n 1 2019-12-24T21:45:29.829 INFO:teuthology.orchestra.run.smithi124.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Tue 24 Dec 2019 09:44:56 PM UTC 2019-12-24T21:45:29.832 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:45:29.833 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:45:29.833 INFO:teuthology.orchestra.run.smithi006:> uname -r 2019-12-24T21:45:29.938 INFO:teuthology.orchestra.run.smithi006.stdout:3.10.0-1062.4.1.el7.x86_64 2019-12-24T21:45:29.938 INFO:teuthology.task.kernel:Running kernel on smithi006: 3.10.0-1062.4.1.el7.x86_64 2019-12-24T21:45:29.939 INFO:teuthology.orchestra.run.smithi006:> sudo yum install -y kernel 2019-12-24T21:45:30.864 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:45:31.128 INFO:teuthology.orchestra.run.smithi006.stdout:Determining fastest mirrors 2019-12-24T21:45:31.740 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:45:31.747 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: ftp.linux.ncsu.edu 2019-12-24T21:45:31.747 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:45:31.748 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:45:45.836 INFO:teuthology.orchestra.run.smithi006.stdout:Resolving Dependencies 2019-12-24T21:45:45.836 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:45:45.836 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package kernel.x86_64 0:3.10.0-1062.9.1.el7 will be installed 2019-12-24T21:45:47.297 INFO:teuthology.orchestra.run.smithi006.stdout:--> Finished Dependency Resolution 2019-12-24T21:45:48.164 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:45:48.164 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies Resolved 2019-12-24T21:45:48.165 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:45:48.165 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:45:48.165 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2019-12-24T21:45:48.165 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:45:48.165 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2019-12-24T21:45:48.165 INFO:teuthology.orchestra.run.smithi006.stdout: kernel x86_64 3.10.0-1062.9.1.el7 updates 50 M 2019-12-24T21:45:48.166 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:45:48.166 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2019-12-24T21:45:48.166 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:45:48.166 INFO:teuthology.orchestra.run.smithi006.stdout:Install 1 Package 2019-12-24T21:45:48.166 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:45:48.166 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 50 M 2019-12-24T21:45:48.166 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 64 M 2019-12-24T21:45:48.167 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading packages: 2019-12-24T21:45:48.177 INFO:teuthology.orchestra.run.smithi006.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-24T21:45:48.996 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2019-12-24T21:45:49.195 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2019-12-24T21:45:49.987 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded 2019-12-24T21:45:49.987 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2019-12-24T21:46:27.852 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-24T21:46:28.378 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-24T21:46:28.378 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:46:28.379 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2019-12-24T21:46:28.379 INFO:teuthology.orchestra.run.smithi006.stdout: kernel.x86_64 0:3.10.0-1062.9.1.el7 2019-12-24T21:46:28.379 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:46:28.379 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2019-12-24T21:46:28.430 INFO:teuthology.orchestra.run.smithi006:> rpm -q kernel --last | head -n 1 2019-12-24T21:46:28.848 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Tue 24 Dec 2019 09:45:53 PM UTC 2019-12-24T21:46:28.850 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:46:28.850 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:46:28.851 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2019-12-24T21:46:28.851 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-12-24T21:46:28.851 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-12-24T21:46:28.851 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-12-24T21:46:28.851 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2019-12-24T21:46:28.851 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=None, version=distro) 2019-12-24T21:46:28.852 INFO:teuthology.orchestra.run.smithi037:> rpm -q kernel --last | head -n 1 2019-12-24T21:46:29.231 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Tue 24 Dec 2019 09:44:10 PM UTC 2019-12-24T21:46:29.233 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:46:29.233 INFO:teuthology.orchestra.run.smithi037:> sudo rpm -qi grub2-tools 2019-12-24T21:46:29.354 INFO:teuthology.orchestra.run.smithi037.stdout:Name : grub2-tools 2019-12-24T21:46:29.354 INFO:teuthology.orchestra.run.smithi037.stdout:Epoch : 1 2019-12-24T21:46:29.354 INFO:teuthology.orchestra.run.smithi037.stdout:Version : 2.02 2019-12-24T21:46:29.354 INFO:teuthology.orchestra.run.smithi037.stdout:Release : 0.76.el7.centos 2019-12-24T21:46:29.354 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: x86_64 2019-12-24T21:46:29.355 INFO:teuthology.orchestra.run.smithi037.stdout:Install Date: Tue 05 Nov 2019 03:40:24 PM UTC 2019-12-24T21:46:29.355 INFO:teuthology.orchestra.run.smithi037.stdout:Group : System Environment/Base 2019-12-24T21:46:29.355 INFO:teuthology.orchestra.run.smithi037.stdout:Size : 10080361 2019-12-24T21:46:29.355 INFO:teuthology.orchestra.run.smithi037.stdout:License : GPLv3+ 2019-12-24T21:46:29.355 INFO:teuthology.orchestra.run.smithi037.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:11 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-12-24T21:46:29.355 INFO:teuthology.orchestra.run.smithi037.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-12-24T21:46:29.355 INFO:teuthology.orchestra.run.smithi037.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-12-24T21:46:29.356 INFO:teuthology.orchestra.run.smithi037.stdout:Build Host : kbuilder.bsys.centos.org 2019-12-24T21:46:29.356 INFO:teuthology.orchestra.run.smithi037.stdout:Relocations : (not relocatable) 2019-12-24T21:46:29.356 INFO:teuthology.orchestra.run.smithi037.stdout:Packager : CentOS BuildSystem 2019-12-24T21:46:29.356 INFO:teuthology.orchestra.run.smithi037.stdout:Vendor : CentOS 2019-12-24T21:46:29.356 INFO:teuthology.orchestra.run.smithi037.stdout:URL : http://www.gnu.org/software/grub/ 2019-12-24T21:46:29.356 INFO:teuthology.orchestra.run.smithi037.stdout:Summary : Support tools for GRUB. 2019-12-24T21:46:29.357 INFO:teuthology.orchestra.run.smithi037.stdout:Description : 2019-12-24T21:46:29.357 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:46:29.357 INFO:teuthology.orchestra.run.smithi037.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-12-24T21:46:29.357 INFO:teuthology.orchestra.run.smithi037.stdout:customizable bootloader with modular architecture. It supports a rich 2019-12-24T21:46:29.357 INFO:teuthology.orchestra.run.smithi037.stdout:variety of kernel formats, file systems, computer architectures and 2019-12-24T21:46:29.357 INFO:teuthology.orchestra.run.smithi037.stdout:hardware devices. 2019-12-24T21:46:29.357 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:46:29.358 INFO:teuthology.orchestra.run.smithi037.stdout:This subpackage provides tools for support of all platforms. 2019-12-24T21:46:29.359 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-12-24T21:46:29.359 INFO:teuthology.task.kernel:Updating grub on smithi037 to boot 3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:46:29.359 INFO:teuthology.orchestra.run.smithi037:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-12-24T21:46:29.843 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2019-12-24T21:46:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:46:30.017 INFO:teuthology.orchestra.run.smithi037.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.9.1.el7.x86_64.img 2019-12-24T21:46:30.308 INFO:teuthology.orchestra.run.smithi037.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-12-24T21:46:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-12-24T21:46:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-12-24T21:46:30.400 INFO:teuthology.orchestra.run.smithi037.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-12-24T21:46:30.436 INFO:teuthology.orchestra.run.smithi037.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-12-24T21:46:30.447 INFO:teuthology.orchestra.run.smithi037.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-12-24T21:46:31.671 INFO:teuthology.orchestra.run.smithi037.stderr:done 2019-12-24T21:46:31.672 INFO:teuthology.orchestra.run.smithi037:> mktemp 2019-12-24T21:46:31.734 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.6kvJDSJ1yJ 2019-12-24T21:46:31.735 INFO:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.6kvJDSJ1yJ 2019-12-24T21:46:31.818 INFO:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.6kvJDSJ1yJ 2019-12-24T21:46:31.964 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.6kvJDSJ1yJ is 6KB 2019-12-24T21:46:32.030 INFO:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.6kvJDSJ1yJ 2019-12-24T21:46:32.094 INFO:teuthology.orchestra.run.smithi037:> sudo grub2-set-default 0 2019-12-24T21:46:32.289 INFO:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2019-12-24T21:46:32.292 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2019-12-24T21:46:32.292 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi124.front.sepia.ceph.com, path=None, version=distro) 2019-12-24T21:46:32.292 INFO:teuthology.orchestra.run.smithi124:> rpm -q kernel --last | head -n 1 2019-12-24T21:46:32.658 INFO:teuthology.orchestra.run.smithi124.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Tue 24 Dec 2019 09:44:56 PM UTC 2019-12-24T21:46:32.660 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:46:32.661 INFO:teuthology.orchestra.run.smithi124:> sudo rpm -qi grub2-tools 2019-12-24T21:46:32.828 INFO:teuthology.orchestra.run.smithi124.stdout:Name : grub2-tools 2019-12-24T21:46:32.828 INFO:teuthology.orchestra.run.smithi124.stdout:Epoch : 1 2019-12-24T21:46:32.829 INFO:teuthology.orchestra.run.smithi124.stdout:Version : 2.02 2019-12-24T21:46:32.829 INFO:teuthology.orchestra.run.smithi124.stdout:Release : 0.76.el7.centos 2019-12-24T21:46:32.829 INFO:teuthology.orchestra.run.smithi124.stdout:Architecture: x86_64 2019-12-24T21:46:32.829 INFO:teuthology.orchestra.run.smithi124.stdout:Install Date: Tue 05 Nov 2019 03:40:24 PM UTC 2019-12-24T21:46:32.829 INFO:teuthology.orchestra.run.smithi124.stdout:Group : System Environment/Base 2019-12-24T21:46:32.829 INFO:teuthology.orchestra.run.smithi124.stdout:Size : 10080361 2019-12-24T21:46:32.830 INFO:teuthology.orchestra.run.smithi124.stdout:License : GPLv3+ 2019-12-24T21:46:32.830 INFO:teuthology.orchestra.run.smithi124.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:11 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-12-24T21:46:32.830 INFO:teuthology.orchestra.run.smithi124.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-12-24T21:46:32.830 INFO:teuthology.orchestra.run.smithi124.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-12-24T21:46:32.830 INFO:teuthology.orchestra.run.smithi124.stdout:Build Host : kbuilder.bsys.centos.org 2019-12-24T21:46:32.830 INFO:teuthology.orchestra.run.smithi124.stdout:Relocations : (not relocatable) 2019-12-24T21:46:32.830 INFO:teuthology.orchestra.run.smithi124.stdout:Packager : CentOS BuildSystem 2019-12-24T21:46:32.831 INFO:teuthology.orchestra.run.smithi124.stdout:Vendor : CentOS 2019-12-24T21:46:32.831 INFO:teuthology.orchestra.run.smithi124.stdout:URL : http://www.gnu.org/software/grub/ 2019-12-24T21:46:32.831 INFO:teuthology.orchestra.run.smithi124.stdout:Summary : Support tools for GRUB. 2019-12-24T21:46:32.831 INFO:teuthology.orchestra.run.smithi124.stdout:Description : 2019-12-24T21:46:32.831 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:46:32.831 INFO:teuthology.orchestra.run.smithi124.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-12-24T21:46:32.831 INFO:teuthology.orchestra.run.smithi124.stdout:customizable bootloader with modular architecture. It supports a rich 2019-12-24T21:46:32.832 INFO:teuthology.orchestra.run.smithi124.stdout:variety of kernel formats, file systems, computer architectures and 2019-12-24T21:46:32.832 INFO:teuthology.orchestra.run.smithi124.stdout:hardware devices. 2019-12-24T21:46:32.832 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:46:32.832 INFO:teuthology.orchestra.run.smithi124.stdout:This subpackage provides tools for support of all platforms. 2019-12-24T21:46:32.833 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-12-24T21:46:32.833 INFO:teuthology.task.kernel:Updating grub on smithi124 to boot 3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:46:32.833 INFO:teuthology.orchestra.run.smithi124:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-12-24T21:46:33.296 INFO:teuthology.orchestra.run.smithi124.stderr:Generating grub configuration file ... 2019-12-24T21:46:33.424 INFO:teuthology.orchestra.run.smithi124.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:46:33.438 INFO:teuthology.orchestra.run.smithi124.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.9.1.el7.x86_64.img 2019-12-24T21:46:33.662 INFO:teuthology.orchestra.run.smithi124.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-12-24T21:46:33.678 INFO:teuthology.orchestra.run.smithi124.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-12-24T21:46:33.705 INFO:teuthology.orchestra.run.smithi124.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-12-24T21:46:33.731 INFO:teuthology.orchestra.run.smithi124.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-12-24T21:46:33.756 INFO:teuthology.orchestra.run.smithi124.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-12-24T21:46:33.764 INFO:teuthology.orchestra.run.smithi124.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-12-24T21:46:34.686 INFO:teuthology.orchestra.run.smithi124.stderr:done 2019-12-24T21:46:34.687 INFO:teuthology.orchestra.run.smithi124:> mktemp 2019-12-24T21:46:34.751 INFO:teuthology.orchestra.run.smithi124.stdout:/tmp/tmp.mHxHXWbDYE 2019-12-24T21:46:34.752 INFO:teuthology.orchestra.run.smithi124:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.mHxHXWbDYE 2019-12-24T21:46:34.824 INFO:teuthology.orchestra.run.smithi124:> sudo chmod 0666 /tmp/tmp.mHxHXWbDYE 2019-12-24T21:46:34.943 DEBUG:teuthology.orchestra.remote:smithi124:/tmp/tmp.mHxHXWbDYE is 6KB 2019-12-24T21:46:34.996 INFO:teuthology.orchestra.run.smithi124:> rm -fr /tmp/tmp.mHxHXWbDYE 2019-12-24T21:46:35.050 INFO:teuthology.orchestra.run.smithi124:> sudo grub2-set-default 0 2019-12-24T21:46:35.212 INFO:teuthology.orchestra.run.smithi124:> sudo shutdown -r now 2019-12-24T21:46:35.216 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2019-12-24T21:46:35.216 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi006.front.sepia.ceph.com, path=None, version=distro) 2019-12-24T21:46:35.216 INFO:teuthology.orchestra.run.smithi006:> rpm -q kernel --last | head -n 1 2019-12-24T21:46:35.586 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Tue 24 Dec 2019 09:45:53 PM UTC 2019-12-24T21:46:35.588 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:46:35.588 INFO:teuthology.orchestra.run.smithi006:> sudo rpm -qi grub2-tools 2019-12-24T21:46:35.708 INFO:teuthology.orchestra.run.smithi006.stdout:Name : grub2-tools 2019-12-24T21:46:35.709 INFO:teuthology.orchestra.run.smithi006.stdout:Epoch : 1 2019-12-24T21:46:35.709 INFO:teuthology.orchestra.run.smithi006.stdout:Version : 2.02 2019-12-24T21:46:35.709 INFO:teuthology.orchestra.run.smithi006.stdout:Release : 0.76.el7.centos 2019-12-24T21:46:35.709 INFO:teuthology.orchestra.run.smithi006.stdout:Architecture: x86_64 2019-12-24T21:46:35.709 INFO:teuthology.orchestra.run.smithi006.stdout:Install Date: Tue 05 Nov 2019 03:40:24 PM UTC 2019-12-24T21:46:35.709 INFO:teuthology.orchestra.run.smithi006.stdout:Group : System Environment/Base 2019-12-24T21:46:35.709 INFO:teuthology.orchestra.run.smithi006.stdout:Size : 10080361 2019-12-24T21:46:35.710 INFO:teuthology.orchestra.run.smithi006.stdout:License : GPLv3+ 2019-12-24T21:46:35.710 INFO:teuthology.orchestra.run.smithi006.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:11 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-12-24T21:46:35.710 INFO:teuthology.orchestra.run.smithi006.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-12-24T21:46:35.710 INFO:teuthology.orchestra.run.smithi006.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-12-24T21:46:35.710 INFO:teuthology.orchestra.run.smithi006.stdout:Build Host : kbuilder.bsys.centos.org 2019-12-24T21:46:35.710 INFO:teuthology.orchestra.run.smithi006.stdout:Relocations : (not relocatable) 2019-12-24T21:46:35.710 INFO:teuthology.orchestra.run.smithi006.stdout:Packager : CentOS BuildSystem 2019-12-24T21:46:35.711 INFO:teuthology.orchestra.run.smithi006.stdout:Vendor : CentOS 2019-12-24T21:46:35.711 INFO:teuthology.orchestra.run.smithi006.stdout:URL : http://www.gnu.org/software/grub/ 2019-12-24T21:46:35.711 INFO:teuthology.orchestra.run.smithi006.stdout:Summary : Support tools for GRUB. 2019-12-24T21:46:35.711 INFO:teuthology.orchestra.run.smithi006.stdout:Description : 2019-12-24T21:46:35.711 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:46:35.711 INFO:teuthology.orchestra.run.smithi006.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-12-24T21:46:35.711 INFO:teuthology.orchestra.run.smithi006.stdout:customizable bootloader with modular architecture. It supports a rich 2019-12-24T21:46:35.712 INFO:teuthology.orchestra.run.smithi006.stdout:variety of kernel formats, file systems, computer architectures and 2019-12-24T21:46:35.712 INFO:teuthology.orchestra.run.smithi006.stdout:hardware devices. 2019-12-24T21:46:35.712 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:46:35.712 INFO:teuthology.orchestra.run.smithi006.stdout:This subpackage provides tools for support of all platforms. 2019-12-24T21:46:35.713 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-12-24T21:46:35.713 INFO:teuthology.task.kernel:Updating grub on smithi006 to boot 3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:46:35.713 INFO:teuthology.orchestra.run.smithi006:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-12-24T21:46:36.195 INFO:teuthology.orchestra.run.smithi006.stderr:Generating grub configuration file ... 2019-12-24T21:46:36.331 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:46:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.9.1.el7.x86_64.img 2019-12-24T21:46:36.598 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-12-24T21:46:36.626 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-12-24T21:46:36.665 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-12-24T21:46:36.683 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-12-24T21:46:36.714 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-12-24T21:46:36.724 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-12-24T21:46:37.839 INFO:teuthology.orchestra.run.smithi006.stderr:done 2019-12-24T21:46:37.841 INFO:teuthology.orchestra.run.smithi006:> mktemp 2019-12-24T21:46:37.968 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.MwfZmqDUUG 2019-12-24T21:46:37.969 INFO:teuthology.orchestra.run.smithi006:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.MwfZmqDUUG 2019-12-24T21:46:38.072 INFO:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.MwfZmqDUUG 2019-12-24T21:46:38.241 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.MwfZmqDUUG is 6KB 2019-12-24T21:46:38.338 INFO:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.MwfZmqDUUG 2019-12-24T21:46:38.419 INFO:teuthology.orchestra.run.smithi006:> sudo grub2-set-default 0 2019-12-24T21:46:38.593 INFO:teuthology.orchestra.run.smithi006:> sudo shutdown -r now 2019-12-24T21:46:38.597 INFO:teuthology.misc:Re-opening connections... 2019-12-24T21:46:38.597 INFO:teuthology.misc:trying to connect to ubuntu@smithi006.front.sepia.ceph.com 2019-12-24T21:46:38.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-24T21:46:38.599 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi006.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:46:38.687 INFO:teuthology.orchestra.run.smithi006:> true 2019-12-24T21:46:39.021 INFO:teuthology.misc:trying to connect to ubuntu@smithi124.front.sepia.ceph.com 2019-12-24T21:46:39.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-24T21:46:39.022 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi124.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:47:13.469 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2019-12-24T21:47:13.470 DEBUG:teuthology.misc:waited 34.8728408813 2019-12-24T21:47:14.470 INFO:teuthology.misc:trying to connect to ubuntu@smithi037.front.sepia.ceph.com 2019-12-24T21:47:14.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-24T21:47:14.471 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi037.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:47:32.920 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2019-12-24T21:47:32.921 INFO:teuthology.misc:trying to connect to ubuntu@smithi124.front.sepia.ceph.com 2019-12-24T21:47:32.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-24T21:47:32.921 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi124.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:47:35.993 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2019-12-24T21:47:35.993 DEBUG:teuthology.misc:waited 57.3962869644 2019-12-24T21:47:36.993 INFO:teuthology.misc:trying to connect to ubuntu@smithi037.front.sepia.ceph.com 2019-12-24T21:47:36.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-24T21:47:36.994 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi037.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:48:36.996 DEBUG:teuthology.orchestra.remote:timed out 2019-12-24T21:48:36.996 INFO:teuthology.misc:trying to connect to ubuntu@smithi124.front.sepia.ceph.com 2019-12-24T21:48:36.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-24T21:48:36.997 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi124.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:48:37.113 INFO:teuthology.orchestra.run.smithi124:> true 2019-12-24T21:48:37.415 DEBUG:teuthology.misc:waited 118.818552971 2019-12-24T21:48:38.417 INFO:teuthology.misc:trying to connect to ubuntu@smithi037.front.sepia.ceph.com 2019-12-24T21:48:38.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-24T21:48:38.418 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi037.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:48:38.534 INFO:teuthology.orchestra.run.smithi037:> true 2019-12-24T21:48:38.989 DEBUG:teuthology.misc:waited 120.392234802 2019-12-24T21:48:39.990 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2019-12-24T21:48:39.991 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "3.10.0-1062.9.1.el7.x86_64"... 2019-12-24T21:48:39.991 INFO:teuthology.orchestra.run.smithi037:> uname -r 2019-12-24T21:48:40.098 INFO:teuthology.orchestra.run.smithi037.stdout:3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:48:40.099 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.9.1.el7.x86_64 vs 3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:48:40.099 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-12-24T21:48:40.099 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2019-12-24T21:48:40.099 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "3.10.0-1062.9.1.el7.x86_64"... 2019-12-24T21:48:40.099 INFO:teuthology.orchestra.run.smithi124:> uname -r 2019-12-24T21:48:40.165 INFO:teuthology.orchestra.run.smithi124.stdout:3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:48:40.165 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.9.1.el7.x86_64 vs 3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:48:40.165 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-12-24T21:48:40.166 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2019-12-24T21:48:40.166 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "3.10.0-1062.9.1.el7.x86_64"... 2019-12-24T21:48:40.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-24T21:48:40.166 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi006.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:48:40.288 INFO:teuthology.orchestra.run.smithi006:> true 2019-12-24T21:48:40.721 INFO:teuthology.orchestra.run.smithi006:> uname -r 2019-12-24T21:48:41.332 INFO:teuthology.orchestra.run.smithi006.stdout:3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:48:41.332 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.9.1.el7.x86_64 vs 3.10.0-1062.9.1.el7.x86_64 2019-12-24T21:48:41.332 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-12-24T21:48:42.333 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2019-12-24T21:48:42.333 INFO:teuthology.orchestra.run.smithi037:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-12-24T21:48:42.485 INFO:teuthology.orchestra.run.smithi037.stdout:ttyS1 2019-12-24T21:48:42.498 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2019-12-24T21:48:42.499 INFO:teuthology.orchestra.run.smithi124:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-12-24T21:48:42.632 INFO:teuthology.orchestra.run.smithi124.stdout:ttyS1 2019-12-24T21:48:42.643 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2019-12-24T21:48:42.643 INFO:teuthology.orchestra.run.smithi006:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-12-24T21:48:42.806 INFO:teuthology.orchestra.run.smithi006.stdout:ttyS1 2019-12-24T21:48:42.820 INFO:teuthology.run_tasks:Running task internal.base... 2019-12-24T21:48:42.828 INFO:teuthology.task.internal:Creating test directory... 2019-12-24T21:48:42.829 INFO:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-12-24T21:48:42.832 INFO:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-12-24T21:48:42.836 INFO:teuthology.orchestra.run.smithi124:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-12-24T21:48:42.926 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2019-12-24T21:48:42.943 INFO:teuthology.run_tasks:Running task internal.archive... 2019-12-24T21:48:43.049 INFO:teuthology.task.internal:Creating archive directory... 2019-12-24T21:48:43.049 INFO:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-12-24T21:48:43.054 INFO:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-12-24T21:48:43.061 INFO:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-12-24T21:48:43.160 INFO:teuthology.run_tasks:Running task internal.coredump... 2019-12-24T21:48:43.176 INFO:teuthology.task.internal:Enabling coredump saving... 2019-12-24T21:48:43.177 INFO:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-24T21:48:43.182 INFO:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-24T21:48:43.187 INFO:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-24T21:48:43.261 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-24T21:48:43.298 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-24T21:48:43.303 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-24T21:48:43.306 INFO:teuthology.run_tasks:Running task internal.sudo... 2019-12-24T21:48:43.318 INFO:teuthology.task.internal:Configuring sudo... 2019-12-24T21:48:43.318 INFO:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-12-24T21:48:43.322 INFO:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-12-24T21:48:43.326 INFO:teuthology.orchestra.run.smithi124:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-12-24T21:48:43.435 INFO:teuthology.run_tasks:Running task internal.syslog... 2019-12-24T21:48:43.454 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2019-12-24T21:48:43.454 INFO:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-12-24T21:48:43.459 INFO:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-12-24T21:48:43.465 INFO:teuthology.orchestra.run.smithi124:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-12-24T21:48:43.545 INFO:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-24T21:48:43.645 INFO:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-24T21:48:43.787 INFO:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-24T21:48:43.895 INFO:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-24T21:48:44.005 INFO:teuthology.orchestra.run.smithi006:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-12-24T21:48:44.104 INFO:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-24T21:48:44.218 INFO:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-24T21:48:44.340 INFO:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-24T21:48:44.429 INFO:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-24T21:48:44.549 INFO:teuthology.orchestra.run.smithi037:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-12-24T21:48:44.651 INFO:teuthology.orchestra.run.smithi124:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-24T21:48:44.749 INFO:teuthology.orchestra.run.smithi124:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-24T21:48:44.835 INFO:teuthology.orchestra.run.smithi124:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-24T21:48:44.892 INFO:teuthology.orchestra.run.smithi124:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-24T21:48:45.005 INFO:teuthology.orchestra.run.smithi124:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-12-24T21:48:45.067 INFO:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2019-12-24T21:48:45.071 INFO:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2019-12-24T21:48:45.075 INFO:teuthology.orchestra.run.smithi124:> sudo service rsyslog restart 2019-12-24T21:48:45.218 INFO:teuthology.orchestra.run.smithi124.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-12-24T21:48:45.222 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-12-24T21:48:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-12-24T21:48:45.308 INFO:teuthology.run_tasks:Running task internal.timer... 2019-12-24T21:48:45.327 INFO:teuthology.task.internal:Starting timer... 2019-12-24T21:48:45.327 INFO:teuthology.run_tasks:Running task pcp... 2019-12-24T21:48:45.365 INFO:teuthology.run_tasks:Running task selinux... 2019-12-24T21:48:45.383 INFO:teuthology.orchestra.run.smithi006:> sudo service auditd rotate 2019-12-24T21:48:45.564 INFO:teuthology.orchestra.run.smithi006.stdout:Rotating logs: [ OK ] 2019-12-24T21:48:45.567 INFO:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2019-12-24T21:48:45.741 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: [ OK ] 2019-12-24T21:48:45.743 INFO:teuthology.orchestra.run.smithi124:> sudo service auditd rotate 2019-12-24T21:48:45.836 INFO:teuthology.orchestra.run.smithi124.stdout:Rotating logs: [ OK ] 2019-12-24T21:48:45.838 DEBUG:teuthology.task.selinux:Getting current SELinux state 2019-12-24T21:48:45.838 INFO:teuthology.orchestra.run.smithi006:> /usr/sbin/getenforce 2019-12-24T21:48:45.940 INFO:teuthology.orchestra.run.smithi006.stdout:Permissive 2019-12-24T21:48:45.940 INFO:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2019-12-24T21:48:46.040 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2019-12-24T21:48:46.040 INFO:teuthology.orchestra.run.smithi124:> /usr/sbin/getenforce 2019-12-24T21:48:46.094 INFO:teuthology.orchestra.run.smithi124.stdout:Permissive 2019-12-24T21:48:46.094 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi124.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi006.front.sepia.ceph.com': 'permissive'} 2019-12-24T21:48:46.095 INFO:teuthology.orchestra.run.smithi006:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-12-24T21:48:46.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-24T21:48:46.224 INFO:teuthology.orchestra.run.smithi037:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-12-24T21:48:46.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-24T21:48:46.353 INFO:teuthology.orchestra.run.smithi124:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-12-24T21:48:46.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-24T21:48:46.422 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2019-12-24T21:48:46.423 INFO:teuthology.orchestra.run.smithi006:> sudo /usr/sbin/setenforce permissive 2019-12-24T21:48:46.551 INFO:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2019-12-24T21:48:46.677 INFO:teuthology.orchestra.run.smithi124:> sudo /usr/sbin/setenforce permissive 2019-12-24T21:48:46.808 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2019-12-24T21:48:46.818 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2019-12-24T21:48:46.818 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2019-12-24T21:48:46.842 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2019-12-24T21:48:46.845 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi037.front.sepia.ceph.com,smithi124.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2019-12-24T21:48:47.223 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2019-12-24T21:48:48.338 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2019-12-24T21:48:51.155 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2019-12-24T21:48:51.179 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:51 +0000 (0:00:00.067) 0:00:00.067 ****** 2019-12-24T21:48:51.191 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:51 +0000 (0:00:00.012) 0:00:00.080 ****** 2019-12-24T21:48:51.204 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:51 +0000 (0:00:00.012) 0:00:00.093 ****** 2019-12-24T21:48:54.423 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi006.front.sepia.ceph.com] 2019-12-24T21:48:54.507 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:54 +0000 (0:00:03.303) 0:00:03.396 ****** 2019-12-24T21:48:54.518 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] 2019-12-24T21:48:54.576 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] 2019-12-24T21:48:54.666 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:54 +0000 (0:00:00.158) 0:00:03.554 ****** 2019-12-24T21:48:54.713 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:54 +0000 (0:00:00.046) 0:00:03.601 ****** 2019-12-24T21:48:55.021 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2019-12-24T21:48:55.023 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-24T21:48:55.079 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:55 +0000 (0:00:00.365) 0:00:03.967 ****** 2019-12-24T21:48:55.085 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-24T21:48:55.086 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-24T21:48:55.127 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:55 +0000 (0:00:00.048) 0:00:04.016 ****** 2019-12-24T21:48:55.175 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:55 +0000 (0:00:00.047) 0:00:04.063 ****** 2019-12-24T21:48:55.732 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2019-12-24T21:48:55.733 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-12-24T21:48:55.735 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-12-24T21:48:55.775 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:55 +0000 (0:00:00.599) 0:00:04.663 ****** 2019-12-24T21:48:55.817 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:55 +0000 (0:00:00.042) 0:00:04.706 ****** 2019-12-24T21:48:55.825 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-12-24T21:48:55.826 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:48:55.871 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:55 +0000 (0:00:00.052) 0:00:04.759 ****** 2019-12-24T21:48:55.912 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:55 +0000 (0:00:00.041) 0:00:04.800 ****** 2019-12-24T21:48:55.918 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:48:55.958 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:55 +0000 (0:00:00.045) 0:00:04.846 ****** 2019-12-24T21:48:55.964 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:48:56.003 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:55 +0000 (0:00:00.045) 0:00:04.891 ****** 2019-12-24T21:48:56.351 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2019-12-24T21:48:56.353 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi124.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-24T21:48:56.410 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:56 +0000 (0:00:00.407) 0:00:05.299 ****** 2019-12-24T21:48:56.454 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:56 +0000 (0:00:00.043) 0:00:05.342 ****** 2019-12-24T21:48:56.462 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-24T21:48:56.499 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:56 +0000 (0:00:00.045) 0:00:05.387 ****** 2019-12-24T21:48:57.930 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2019-12-24T21:48:57.930 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577224136.48-77718359353278/source", "state": "file", "uid": 0} 2019-12-24T21:48:57.989 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:57 +0000 (0:00:01.490) 0:00:06.878 ****** 2019-12-24T21:48:57.995 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577224136.44-247954415701159/source", "state": "file", "uid": 0} 2019-12-24T21:48:58.036 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:58 +0000 (0:00:00.046) 0:00:06.924 ****** 2019-12-24T21:48:58.042 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577224136.52-209900997715032/source", "state": "file", "uid": 0} 2019-12-24T21:48:58.098 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:48:58 +0000 (0:00:00.062) 0:00:06.987 ****** 2019-12-24T21:48:58.595 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2019-12-24T21:48:58.596 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:48:58.619 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:48:58.620 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:48:58.920 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:48:58.965 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:48:58.966 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:48:59.193 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:48:59.320 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:48:59.353 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:48:59.471 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:48:59.673 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:48:59.696 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:48:59.793 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:48:59.996 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:49:00.049 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:49:00.123 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:49:00.347 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:49:00.411 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:49:00.487 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:49:00.679 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:49:00.768 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-24T21:49:00.876 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2019-12-24T21:49:00.882 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2019-12-24T21:49:01.097 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:01 +0000 (0:00:02.999) 0:00:09.986 ****** 2019-12-24T21:49:01.134 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:01 +0000 (0:00:00.036) 0:00:10.022 ****** 2019-12-24T21:49:01.169 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:01 +0000 (0:00:00.035) 0:00:10.057 ****** 2019-12-24T21:49:02.078 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2019-12-24T21:49:02.079 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] 2019-12-24T21:49:02.138 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] 2019-12-24T21:49:02.216 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2019-12-24T21:49:02.218 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:02 +0000 (0:00:01.047) 0:00:11.105 ****** 2019-12-24T21:49:02.264 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] 2019-12-24T21:49:02.342 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:02 +0000 (0:00:00.125) 0:00:11.231 ****** 2019-12-24T21:49:02.399 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:02 +0000 (0:00:00.056) 0:00:11.287 ****** 2019-12-24T21:49:02.770 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi124.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.251397", "end": "2019-12-24 21:49:02.749716", "rc": 0, "start": "2019-12-24 21:49:02.498319", "stderr": "", "stderr_lines": [], "stdout": "f4e10beea550ddcc5081090533acfa405cd36c43", "stdout_lines": ["f4e10beea550ddcc5081090533acfa405cd36c43"]} 2019-12-24T21:49:02.822 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:02 +0000 (0:00:00.423) 0:00:11.711 ****** 2019-12-24T21:49:02.832 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.263428", "end": "2019-12-24 21:49:02.752345", "rc": 0, "start": "2019-12-24 21:49:02.488917", "stderr": "", "stderr_lines": [], "stdout": "f4e10beea550ddcc5081090533acfa405cd36c43", "stdout_lines": ["f4e10beea550ddcc5081090533acfa405cd36c43"]} 2019-12-24T21:49:02.834 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.233140", "end": "2019-12-24 21:49:02.768904", "rc": 0, "start": "2019-12-24 21:49:02.535764", "stderr": "", "stderr_lines": [], "stdout": "f4e10beea550ddcc5081090533acfa405cd36c43", "stdout_lines": ["f4e10beea550ddcc5081090533acfa405cd36c43"]} 2019-12-24T21:49:02.881 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:02 +0000 (0:00:00.058) 0:00:11.769 ****** 2019-12-24T21:49:02.922 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:02 +0000 (0:00:00.040) 0:00:11.810 ****** 2019-12-24T21:49:03.124 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi124.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.009530", "end": "2019-12-24 21:49:03.099900", "failed_when_result": false, "rc": 0, "start": "2019-12-24 21:49:03.090370", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-12-24T21:49:03.162 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:03 +0000 (0:00:00.240) 0:00:12.051 ****** 2019-12-24T21:49:03.192 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-12-24T21:49:03.193 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:03.239 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:03 +0000 (0:00:00.076) 0:00:12.127 ****** 2019-12-24T21:49:03.245 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2019-12-24T21:49:03.247 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.011087", "end": "2019-12-24 21:49:03.192416", "failed_when_result": false, "rc": 0, "start": "2019-12-24 21:49:03.181329", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-12-24T21:49:03.291 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:03 +0000 (0:00:00.051) 0:00:12.179 ****** 2019-12-24T21:49:03.298 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.012274", "end": "2019-12-24 21:49:03.236695", "failed_when_result": false, "rc": 0, "start": "2019-12-24 21:49:03.224421", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-12-24T21:49:03.299 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-12-24T21:49:03.300 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:03.344 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:03 +0000 (0:00:00.053) 0:00:12.232 ****** 2019-12-24T21:49:03.378 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:03 +0000 (0:00:00.033) 0:00:12.266 ****** 2019-12-24T21:49:03.385 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-12-24T21:49:03.386 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:03.426 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:03 +0000 (0:00:00.048) 0:00:12.314 ****** 2019-12-24T21:49:03.462 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:03 +0000 (0:00:00.035) 0:00:12.349 ****** 2019-12-24T21:49:03.468 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-12-24T21:49:03.469 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:03.510 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:03 +0000 (0:00:00.048) 0:00:12.398 ****** 2019-12-24T21:49:03.545 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:03 +0000 (0:00:00.035) 0:00:12.433 ****** 2019-12-24T21:49:03.552 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:03.594 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:03 +0000 (0:00:00.048) 0:00:12.482 ****** 2019-12-24T21:49:03.628 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:03 +0000 (0:00:00.034) 0:00:12.517 ****** 2019-12-24T21:49:03.634 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2019-12-24T21:49:03.634 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:03.636 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:03.673 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:03 +0000 (0:00:00.044) 0:00:12.561 ****** 2019-12-24T21:49:03.712 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:03 +0000 (0:00:00.038) 0:00:12.600 ****** 2019-12-24T21:49:03.718 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-12-24T21:49:03.719 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:03.758 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:03 +0000 (0:00:00.045) 0:00:12.646 ****** 2019-12-24T21:49:03.791 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:03 +0000 (0:00:00.033) 0:00:12.679 ****** 2019-12-24T21:49:03.796 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:03.835 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:03 +0000 (0:00:00.044) 0:00:12.724 ****** 2019-12-24T21:49:03.841 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2019-12-24T21:49:03.842 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:03.880 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:03 +0000 (0:00:00.044) 0:00:12.768 ****** 2019-12-24T21:49:03.907 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2019-12-24T21:49:03.908 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:03.945 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:03 +0000 (0:00:00.065) 0:00:12.833 ****** 2019-12-24T21:49:04.110 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* ok: [smithi006.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-24T21:49:04.156 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:04 +0000 (0:00:00.210) 0:00:13.044 ****** 2019-12-24T21:49:04.163 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-24T21:49:04.206 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:04 +0000 (0:00:00.050) 0:00:13.095 ****** 2019-12-24T21:49:04.266 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-24T21:49:04.305 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:04 +0000 (0:00:00.099) 0:00:13.194 ****** 2019-12-24T21:49:04.535 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-24T21:49:04.535 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-12-24T21:49:04.573 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-12-24T21:49:04.745 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-12-24T21:49:04.820 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-12-24T21:49:04.930 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-12-24T21:49:05.085 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-12-24T21:49:05.161 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-12-24T21:49:05.280 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-12-24T21:49:05.443 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-12-24T21:49:05.521 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-12-24T21:49:05.630 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-12-24T21:49:05.788 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-12-24T21:49:05.811 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-12-24T21:49:05.993 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-12-24T21:49:06.157 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-12-24T21:49:06.158 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-12-24T21:49:06.343 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-12-24T21:49:06.515 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-12-24T21:49:06.518 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-12-24T21:49:06.710 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-12-24T21:49:06.876 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-12-24T21:49:06.878 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-12-24T21:49:07.058 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-12-24T21:49:07.215 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-12-24T21:49:07.227 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-12-24T21:49:07.413 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-12-24T21:49:07.533 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-12-24T21:49:07.581 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-12-24T21:49:07.787 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-12-24T21:49:07.882 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-12-24T21:49:07.936 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-12-24T21:49:08.172 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-12-24T21:49:08.228 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-12-24T21:49:08.324 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-12-24T21:49:08.514 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-12-24T21:49:08.590 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-12-24T21:49:08.665 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-12-24T21:49:08.844 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-12-24T21:49:08.949 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-12-24T21:49:08.992 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-12-24T21:49:09.192 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-12-24T21:49:09.238 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-12-24T21:49:09.339 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-12-24T21:49:09.532 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-12-24T21:49:09.576 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-12-24T21:49:09.697 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-12-24T21:49:09.899 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-12-24T21:49:09.900 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-12-24T21:49:10.023 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-12-24T21:49:10.146 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-12-24T21:49:10.242 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-12-24T21:49:10.372 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-12-24T21:49:10.470 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-12-24T21:49:10.588 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-12-24T21:49:10.740 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-12-24T21:49:10.793 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-12-24T21:49:10.958 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-12-24T21:49:11.074 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-12-24T21:49:11.148 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-12-24T21:49:11.303 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-12-24T21:49:11.420 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-12-24T21:49:11.488 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-12-24T21:49:11.629 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-12-24T21:49:11.756 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-12-24T21:49:11.789 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-12-24T21:49:11.969 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-12-24T21:49:12.086 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-12-24T21:49:12.087 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-12-24T21:49:12.283 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-12-24T21:49:12.427 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-12-24T21:49:12.440 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-12-24T21:49:12.631 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-12-24T21:49:12.770 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-12-24T21:49:12.795 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-12-24T21:49:12.979 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-12-24T21:49:13.107 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-12-24T21:49:13.120 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-12-24T21:49:13.334 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-12-24T21:49:13.441 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-12-24T21:49:13.443 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-12-24T21:49:13.678 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-12-24T21:49:13.805 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-12-24T21:49:13.806 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-12-24T21:49:14.007 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-12-24T21:49:14.135 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-12-24T21:49:14.168 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-12-24T21:49:14.351 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-12-24T21:49:14.486 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-12-24T21:49:14.674 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-12-24T21:49:14.815 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-12-24T21:49:14.827 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-12-24T21:49:15.029 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-12-24T21:49:15.149 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-12-24T21:49:15.193 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-12-24T21:49:15.384 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-12-24T21:49:15.501 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-12-24T21:49:15.534 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-12-24T21:49:15.730 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-12-24T21:49:15.857 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-12-24T21:49:15.901 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-12-24T21:49:16.074 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-12-24T21:49:16.202 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-12-24T21:49:16.228 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-12-24T21:49:16.429 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-12-24T21:49:16.553 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-12-24T21:49:16.565 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-12-24T21:49:16.785 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-12-24T21:49:16.902 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-24T21:49:16.925 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-12-24T21:49:17.120 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-12-24T21:49:17.242 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-12-24T21:49:17.275 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-12-24T21:49:17.473 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-24T21:49:17.590 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-24T21:49:17.623 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-24T21:49:17.816 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-12-24T21:49:17.945 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-12-24T21:49:17.977 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-12-24T21:49:18.158 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-24T21:49:18.281 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-12-24T21:49:18.335 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-24T21:49:18.524 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-12-24T21:49:18.594 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-12-24T21:49:18.669 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-12-24T21:49:18.880 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-12-24T21:49:18.936 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-12-24T21:49:19.012 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-12-24T21:49:19.234 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-12-24T21:49:19.256 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-24T21:49:19.363 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-12-24T21:49:19.587 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-12-24T21:49:19.599 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-12-24T21:49:19.725 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-12-24T21:49:19.909 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-12-24T21:49:19.972 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-24T21:49:20.089 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-24T21:49:20.256 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-24T21:49:20.319 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-12-24T21:49:20.404 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-12-24T21:49:20.612 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-12-24T21:49:20.677 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-12-24T21:49:20.752 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-12-24T21:49:20.954 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-12-24T21:49:21.019 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-24T21:49:21.084 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-24T21:49:21.303 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-12-24T21:49:21.422 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-12-24T21:49:21.445 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-12-24T21:49:21.625 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-12-24T21:49:21.798 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-12-24T21:49:21.800 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-12-24T21:49:21.971 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-12-24T21:49:22.141 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-12-24T21:49:22.163 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-12-24T21:49:22.334 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-12-24T21:49:22.472 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-12-24T21:49:22.494 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-12-24T21:49:22.665 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-12-24T21:49:22.833 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-12-24T21:49:22.834 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-12-24T21:49:23.015 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-12-24T21:49:23.173 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-12-24T21:49:23.216 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-12-24T21:49:23.395 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-12-24T21:49:23.490 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-12-24T21:49:23.533 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-12-24T21:49:23.737 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-12-24T21:49:23.832 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-12-24T21:49:23.886 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-12-24T21:49:24.077 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-12-24T21:49:24.172 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-12-24T21:49:24.241 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-12-24T21:49:24.418 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-12-24T21:49:24.513 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-12-24T21:49:24.595 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-12-24T21:49:24.753 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-12-24T21:49:24.848 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-12-24T21:49:24.970 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-12-24T21:49:25.086 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-12-24T21:49:25.194 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-12-24T21:49:25.331 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-12-24T21:49:25.419 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-12-24T21:49:25.515 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-12-24T21:49:25.696 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-12-24T21:49:25.772 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-12-24T21:49:25.903 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-12-24T21:49:26.047 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-12-24T21:49:26.113 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-24T21:49:26.243 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-12-24T21:49:26.402 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-12-24T21:49:26.456 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-12-24T21:49:26.582 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-12-24T21:49:26.772 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-12-24T21:49:26.816 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-12-24T21:49:26.892 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-24T21:49:27.087 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-24T21:49:27.153 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-12-24T21:49:27.229 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-12-24T21:49:27.421 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-12-24T21:49:27.498 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-12-24T21:49:27.563 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-12-24T21:49:27.765 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-12-24T21:49:27.839 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-12-24T21:49:27.903 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-12-24T21:49:28.133 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-12-24T21:49:28.176 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-12-24T21:49:28.249 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-12-24T21:49:28.472 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-12-24T21:49:28.525 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-12-24T21:49:28.569 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-12-24T21:49:28.793 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-12-24T21:49:28.867 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-12-24T21:49:28.922 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-12-24T21:49:29.144 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-12-24T21:49:29.209 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-12-24T21:49:29.273 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-12-24T21:49:29.504 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-12-24T21:49:29.561 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-12-24T21:49:29.637 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-12-24T21:49:29.850 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-12-24T21:49:29.885 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-12-24T21:49:29.992 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-12-24T21:49:30.201 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-12-24T21:49:30.234 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-12-24T21:49:30.334 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-12-24T21:49:30.536 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-12-24T21:49:30.547 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-12-24T21:49:30.704 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-12-24T21:49:30.878 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-12-24T21:49:30.915 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-12-24T21:49:31.052 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-12-24T21:49:31.216 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-12-24T21:49:31.249 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-12-24T21:49:31.379 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-12-24T21:49:31.541 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-12-24T21:49:31.588 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-12-24T21:49:31.714 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-12-24T21:49:31.871 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-12-24T21:49:31.939 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-12-24T21:49:32.014 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-12-24T21:49:32.212 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-12-24T21:49:32.296 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-12-24T21:49:32.361 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-12-24T21:49:32.545 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-12-24T21:49:32.629 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-12-24T21:49:32.700 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-12-24T21:49:32.868 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-12-24T21:49:32.975 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-12-24T21:49:33.040 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-12-24T21:49:33.220 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-12-24T21:49:33.339 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-12-24T21:49:33.383 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-12-24T21:49:33.572 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-12-24T21:49:33.696 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-12-24T21:49:33.729 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-12-24T21:49:33.912 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-12-24T21:49:34.052 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-12-24T21:49:34.087 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-12-24T21:49:34.245 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-12-24T21:49:34.394 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-12-24T21:49:34.437 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-12-24T21:49:34.590 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-12-24T21:49:34.727 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-12-24T21:49:34.812 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-12-24T21:49:34.932 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-12-24T21:49:35.058 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-12-24T21:49:35.174 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-12-24T21:49:35.270 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-12-24T21:49:35.409 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-12-24T21:49:35.494 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-12-24T21:49:35.611 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-12-24T21:49:35.737 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-12-24T21:49:35.860 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-12-24T21:49:36.062 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-12-24T21:49:36.074 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-12-24T21:49:36.222 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-12-24T21:49:36.223 INFO:teuthology.task.ansible.out: 2019-12-24T21:49:36.403 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-12-24T21:49:36.415 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-12-24T21:49:36.562 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-12-24T21:49:36.755 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-12-24T21:49:36.756 INFO:teuthology.task.ansible.out: 2019-12-24T21:49:36.761 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-12-24T21:49:37.050 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-12-24T21:49:37.097 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-12-24T21:49:37.255 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-12-24T21:49:37.414 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-12-24T21:49:37.458 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-12-24T21:49:37.597 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-12-24T21:49:37.750 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-12-24T21:49:37.793 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-12-24T21:49:37.929 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-12-24T21:49:38.111 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-12-24T21:49:38.132 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-12-24T21:49:38.269 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-12-24T21:49:38.462 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-12-24T21:49:38.484 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-12-24T21:49:38.635 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-12-24T21:49:38.821 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-12-24T21:49:38.843 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-12-24T21:49:38.958 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-12-24T21:49:39.163 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-12-24T21:49:39.177 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-24T21:49:39.304 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-12-24T21:49:39.501 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-12-24T21:49:39.524 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-12-24T21:49:39.630 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-12-24T21:49:39.846 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-12-24T21:49:39.973 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-12-24T21:49:40.213 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-24T21:49:40.228 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-12-24T21:49:40.307 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-24T21:49:40.565 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-12-24T21:49:40.649 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-12-24T21:49:40.651 INFO:teuthology.task.ansible.out: 2019-12-24T21:49:40.872 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "name": "toabctl", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2019-12-24T21:49:41.293 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-12-24T21:49:41.347 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-12-24T21:49:41.506 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2019-12-24T21:49:41.655 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:41 +0000 (0:00:37.349) 0:00:50.543 ****** 2019-12-24T21:49:41.682 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-12-24T21:49:41.719 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:41 +0000 (0:00:00.064) 0:00:50.607 ****** 2019-12-24T21:49:41.776 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* ok: [smithi124.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz 2019-12-24T21:49:41.778 INFO:teuthology.task.ansible.out:2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwb 2019-12-24T21:49:41.779 INFO:teuthology.task.ansible.out:x8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db 2019-12-24T21:49:41.781 INFO:teuthology.task.ansible.out:6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239 2019-12-24T21:49:41.782 INFO:teuthology.task.ansible.out:d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJy 2019-12-24T21:49:41.783 INFO:teuthology.task.ansible.out:w 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", 2019-12-24T21:49:41.784 INFO:teuthology.task.ansible.out: "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com 2019-12-24T21:49:41.786 INFO:teuthology.task.ansible.out:Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzne 2019-12-24T21:49:41.787 INFO:teuthology.task.ansible.out:r@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"nam 2019-12-24T21:49:41.788 INFO:teuthology.task.ansible.out:e": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34 2019-12-24T21:49:41.790 INFO:teuthology.task.ansible.out:103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c 2019-12-24T21:49:41.791 INFO:teuthology.task.ansible.out:553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}]}, "changed": false} 2019-12-24T21:49:41.830 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:41 +0000 (0:00:00.109) 0:00:50.717 ****** 2019-12-24T21:49:41.910 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-24T21:49:41.910 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "name": "toabctl", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2019-12-24T21:49:41.923 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "name": "toabctl", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2019-12-24T21:49:42.509 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2019-12-24T21:49:42.652 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2019-12-24T21:49:42.755 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:42 +0000 (0:00:00.924) 0:00:51.642 ****** 2019-12-24T21:49:42.797 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:42 +0000 (0:00:00.043) 0:00:51.685 ****** 2019-12-24T21:49:42.803 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2019-12-24T21:49:42.804 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com -> localhost] => {"after": "f4e10beea550ddcc5081090533acfa405cd36c43", "attempts": 1, "before": "f4e10beea550ddcc5081090533acfa405cd36c43", "changed": false, "remote_url_changed": false} 2019-12-24T21:49:42.806 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-12-24T21:49:42.847 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:42 +0000 (0:00:00.050) 0:00:51.735 ****** 2019-12-24T21:49:42.881 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:42 +0000 (0:00:00.033) 0:00:51.769 ****** 2019-12-24T21:49:42.926 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:42 +0000 (0:00:00.045) 0:00:51.815 ****** 2019-12-24T21:49:42.936 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-12-24T21:49:42.940 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-12-24T21:49:42.941 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7 2019-12-24T21:49:42.943 INFO:teuthology.task.ansible.out:L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32 2019-12-24T21:49:42.944 INFO:teuthology.task.ansible.out:f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b 2019-12-24T21:49:42.946 INFO:teuthology.task.ansible.out:09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e 2019-12-24T21:49:42.948 INFO:teuthology.task.ansible.out:66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa 2019-12-24T21:49:42.949 INFO:teuthology.task.ansible.out:8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 2019-12-24T21:49:42.950 INFO:teuthology.task.ansible.out:6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f 2019-12-24T21:49:42.951 INFO:teuthology.task.ansible.out:826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd1 2019-12-24T21:49:42.953 INFO:teuthology.task.ansible.out:7f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 2019-12-24T21:49:42.954 INFO:teuthology.task.ansible.out: 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn" 2019-12-24T21:49:42.955 INFO:teuthology.task.ansible.out:: "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}]}, "changed": false} 2019-12-24T21:49:43.001 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:42 +0000 (0:00:00.067) 0:00:51.883 ****** 2019-12-24T21:49:43.009 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-12-24T21:49:43.011 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7 2019-12-24T21:49:43.012 INFO:teuthology.task.ansible.out:L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32 2019-12-24T21:49:43.014 INFO:teuthology.task.ansible.out:f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b 2019-12-24T21:49:43.015 INFO:teuthology.task.ansible.out:09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e 2019-12-24T21:49:43.017 INFO:teuthology.task.ansible.out:66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa 2019-12-24T21:49:43.018 INFO:teuthology.task.ansible.out:8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 2019-12-24T21:49:43.019 INFO:teuthology.task.ansible.out:6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f 2019-12-24T21:49:43.020 INFO:teuthology.task.ansible.out:826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd1 2019-12-24T21:49:43.022 INFO:teuthology.task.ansible.out:7f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 2019-12-24T21:49:43.023 INFO:teuthology.task.ansible.out: 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn" 2019-12-24T21:49:43.025 INFO:teuthology.task.ansible.out:: "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}]}, "changed": false} 2019-12-24T21:49:43.062 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:43 +0000 (0:00:00.066) 0:00:51.949 ****** 2019-12-24T21:49:43.306 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-24T21:49:43.307 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-12-24T21:49:43.682 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2019-12-24T21:49:43.686 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com -> localhost] => {"after": "f4e10beea550ddcc5081090533acfa405cd36c43", "attempts": 1, "before": "f4e10beea550ddcc5081090533acfa405cd36c43", "changed": false, "remote_url_changed": false} 2019-12-24T21:49:43.688 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-24T21:49:43.695 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-12-24T21:49:43.741 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:43 +0000 (0:00:00.680) 0:00:52.630 ****** 2019-12-24T21:49:43.810 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2019-12-24T21:49:43.811 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com -> localhost] => {"after": "f4e10beea550ddcc5081090533acfa405cd36c43", "attempts": 1, "before": "f4e10beea550ddcc5081090533acfa405cd36c43", "changed": false, "remote_url_changed": false} 2019-12-24T21:49:43.854 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:49:43 +0000 (0:00:00.112) 0:00:52.742 ****** 2019-12-24T21:49:44.035 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-12-24T21:49:44.151 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-12-24T21:49:44.258 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-12-24T21:49:44.353 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-12-24T21:49:44.506 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-12-24T21:49:44.613 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-12-24T21:49:44.677 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-12-24T21:49:44.679 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-12-24T21:49:44.876 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-12-24T21:49:44.960 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-12-24T21:49:45.048 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-12-24T21:49:45.238 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-12-24T21:49:45.337 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-12-24T21:49:45.400 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-12-24T21:49:45.402 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-12-24T21:49:45.602 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-12-24T21:49:45.604 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-12-24T21:49:45.676 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-12-24T21:49:45.678 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-12-24T21:49:45.719 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-12-24T21:49:45.968 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-12-24T21:49:46.033 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-12-24T21:49:46.066 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-12-24T21:49:46.077 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:46.326 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-12-24T21:49:46.328 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-12-24T21:49:46.349 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-12-24T21:49:46.351 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-12-24T21:49:46.415 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-12-24T21:49:46.417 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-12-24T21:49:46.437 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:46.459 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:46.480 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:46.681 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-12-24T21:49:46.723 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-12-24T21:49:46.822 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-12-24T21:49:46.998 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-12-24T21:49:46.999 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:47.046 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-12-24T21:49:47.068 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:47.185 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-12-24T21:49:47.186 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-12-24T21:49:47.347 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-12-24T21:49:47.348 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:47.358 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:47.369 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:47.412 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-12-24T21:49:47.414 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-12-24T21:49:47.423 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:47.434 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:47.446 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:49:47.499 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-12-24T21:49:47.660 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-12-24T21:49:47.807 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-12-24T21:49:47.835 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-12-24T21:49:48.002 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-12-24T21:49:48.004 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-12-24T21:49:48.170 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-12-24T21:49:48.171 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-12-24T21:49:48.172 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-12-24T21:49:48.335 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-12-24T21:49:48.516 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-12-24T21:49:48.622 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-12-24T21:49:48.761 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-12-24T21:49:48.961 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-12-24T21:49:49.003 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-12-24T21:49:49.092 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-12-24T21:49:49.279 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-12-24T21:49:49.362 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-12-24T21:49:49.416 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-12-24T21:49:49.645 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-12-24T21:49:49.646 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-12-24T21:49:49.729 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-12-24T21:49:49.751 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-12-24T21:49:50.005 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-12-24T21:49:50.007 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-12-24T21:49:50.089 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-12-24T21:49:50.090 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-12-24T21:49:50.353 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-12-24T21:49:50.438 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw- 2019-12-24T21:49:50.440 INFO:teuthology.task.ansible.out:RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-12-24T21:49:50.716 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-12-24T21:49:50.780 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-12-24T21:49:50.782 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-12-24T21:49:50.791 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-12-24T21:49:50.793 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-12-24T21:49:51.055 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-12-24T21:49:51.057 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-12-24T21:49:51.120 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-12-24T21:49:51.133 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-12-24T21:49:51.135 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-12-24T21:49:51.346 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-12-24T21:49:51.463 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-12-24T21:49:51.483 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-12-24T21:49:51.682 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-12-24T21:49:51.804 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-12-24T21:49:51.806 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-12-24T21:49:51.837 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-12-24T21:49:52.045 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-12-24T21:49:52.161 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-12-24T21:49:52.205 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-12-24T21:49:52.207 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-12-24T21:49:52.393 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-12-24T21:49:52.498 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-12-24T21:49:52.551 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-12-24T21:49:52.750 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-12-24T21:49:52.848 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-12-24T21:49:52.921 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-12-24T21:49:53.099 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-12-24T21:49:53.101 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-12-24T21:49:53.188 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-12-24T21:49:53.267 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-12-24T21:49:53.459 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-12-24T21:49:53.565 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-12-24T21:49:53.641 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-12-24T21:49:53.787 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-12-24T21:49:53.913 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-12-24T21:49:53.915 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-12-24T21:49:53.987 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-12-24T21:49:54.113 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-12-24T21:49:54.259 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-12-24T21:49:54.365 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-12-24T21:49:54.367 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-12-24T21:49:54.457 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-12-24T21:49:54.618 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-12-24T21:49:54.681 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-12-24T21:49:54.793 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-12-24T21:49:54.976 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-12-24T21:49:55.030 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-12-24T21:49:55.163 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-12-24T21:49:55.333 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-12-24T21:49:55.344 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-12-24T21:49:55.524 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-24T21:49:55.674 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-12-24T21:49:55.707 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-12-24T21:49:55.891 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-12-24T21:49:56.039 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-12-24T21:49:56.081 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-12-24T21:49:56.249 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-12-24T21:49:56.386 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-24T21:49:56.429 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-12-24T21:49:56.591 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-12-24T21:49:56.592 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-12-24T21:49:56.716 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-12-24T21:49:56.780 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-24T21:49:56.937 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-12-24T21:49:56.938 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-12-24T21:49:57.053 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-12-24T21:49:57.127 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-12-24T21:49:57.263 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-12-24T21:49:57.403 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-12-24T21:49:57.404 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-12-24T21:49:57.499 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-12-24T21:49:57.614 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-12-24T21:49:57.745 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-12-24T21:49:57.747 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-12-24T21:49:57.861 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-12-24T21:49:57.862 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-12-24T21:49:57.935 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-12-24T21:49:58.103 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-12-24T21:49:58.208 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-12-24T21:49:58.209 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-12-24T21:49:58.271 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-12-24T21:49:58.273 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-24T21:49:58.468 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-12-24T21:49:58.568 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-12-24T21:49:58.591 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-12-24T21:49:58.592 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-12-24T21:49:58.594 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-12-24T21:49:58.830 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-12-24T21:49:58.913 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-12-24T21:49:58.925 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-12-24T21:49:59.185 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-12-24T21:49:59.187 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-24T21:49:59.238 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-12-24T21:49:59.260 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-12-24T21:49:59.562 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-12-24T21:49:59.563 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-12-24T21:49:59.565 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-12-24T21:49:59.594 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-12-24T21:49:59.605 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-12-24T21:49:59.607 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-24T21:49:59.916 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-12-24T21:49:59.937 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-12-24T21:49:59.980 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-12-24T21:49:59.982 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-12-24T21:49:59.984 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-12-24T21:50:00.258 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-12-24T21:50:00.280 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-12-24T21:50:00.337 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-12-24T21:50:00.634 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-12-24T21:50:00.648 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-12-24T21:50:00.680 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-12-24T21:50:00.984 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-12-24T21:50:00.996 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-12-24T21:50:01.039 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-12-24T21:50:01.285 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-12-24T21:50:01.297 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-12-24T21:50:01.361 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-12-24T21:50:01.607 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-12-24T21:50:01.608 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-12-24T21:50:01.626 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-12-24T21:50:01.685 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-12-24T21:50:01.946 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-12-24T21:50:01.948 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-12-24T21:50:02.022 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-12-24T21:50:02.300 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-12-24T21:50:02.322 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-12-24T21:50:02.386 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-12-24T21:50:02.633 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-12-24T21:50:02.635 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-12-24T21:50:02.645 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-12-24T21:50:02.646 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-12-24T21:50:02.762 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-12-24T21:50:02.975 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-12-24T21:50:02.996 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-12-24T21:50:02.998 INFO:teuthology.task.ansible.out: 2019-12-24T21:50:03.130 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-12-24T21:50:03.131 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-12-24T21:50:03.319 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-12-24T21:50:03.352 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-12-24T21:50:03.501 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-12-24T21:50:03.653 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-12-24T21:50:03.716 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-12-24T21:50:03.717 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-12-24T21:50:03.853 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-12-24T21:50:03.991 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-24T21:50:04.069 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-12-24T21:50:04.221 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-12-24T21:50:04.223 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-12-24T21:50:04.326 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-12-24T21:50:04.421 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-12-24T21:50:04.423 INFO:teuthology.task.ansible.out: 2019-12-24T21:50:04.569 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-12-24T21:50:04.643 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-12-24T21:50:04.749 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-12-24T21:50:04.922 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-12-24T21:50:04.956 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-12-24T21:50:05.087 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-24T21:50:05.272 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-12-24T21:50:05.283 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-12-24T21:50:05.433 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-12-24T21:50:05.596 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-24T21:50:05.597 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-12-24T21:50:05.778 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-12-24T21:50:05.947 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-12-24T21:50:05.958 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-12-24T21:50:06.139 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-12-24T21:50:06.287 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-12-24T21:50:06.300 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-12-24T21:50:06.477 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-12-24T21:50:06.634 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-12-24T21:50:06.656 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-12-24T21:50:06.819 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-12-24T21:50:06.977 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-12-24T21:50:06.999 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-12-24T21:50:07.164 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-12-24T21:50:07.321 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-12-24T21:50:07.333 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-12-24T21:50:07.531 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-12-24T21:50:07.663 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g 2019-12-24T21:50:07.665 INFO:teuthology.task.ansible.out:/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-12-24T21:50:07.859 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-12-24T21:50:07.943 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-12-24T21:50:08.017 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-12-24T21:50:08.205 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-12-24T21:50:08.278 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-12-24T21:50:08.353 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-12-24T21:50:08.572 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-12-24T21:50:08.615 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-12-24T21:50:08.709 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-12-24T21:50:08.933 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-12-24T21:50:08.966 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-12-24T21:50:09.075 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-12-24T21:50:09.221 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-12-24T21:50:09.284 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-12-24T21:50:09.419 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-12-24T21:50:09.556 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-12-24T21:50:09.609 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-12-24T21:50:09.751 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/Z 2019-12-24T21:50:09.760 INFO:teuthology.task.ansible.out:yG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-12-24T21:50:09.762 INFO:teuthology.task.ansible.out: 2019-12-24T21:50:09.878 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-12-24T21:50:09.921 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-12-24T21:50:10.123 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-12-24T21:50:10.238 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-12-24T21:50:10.301 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-12-24T21:50:10.459 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-12-24T21:50:10.607 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-12-24T21:50:10.667 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-12-24T21:50:10.813 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-12-24T21:50:10.960 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-12-24T21:50:10.992 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-12-24T21:50:11.134 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-12-24T21:50:11.324 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-12-24T21:50:11.346 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-12-24T21:50:11.347 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-12-24T21:50:11.463 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-12-24T21:50:11.668 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-12-24T21:50:11.706 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-12-24T21:50:11.708 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-12-24T21:50:11.820 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-12-24T21:50:12.040 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-12-24T21:50:12.051 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-12-24T21:50:12.178 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-12-24T21:50:12.369 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-12-24T21:50:12.391 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-12-24T21:50:12.542 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-12-24T21:50:12.719 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-12-24T21:50:12.741 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-12-24T21:50:12.742 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-12-24T21:50:12.889 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-12-24T21:50:13.060 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-12-24T21:50:13.113 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-12-24T21:50:13.115 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-12-24T21:50:13.228 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-12-24T21:50:13.230 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-12-24T21:50:13.399 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-12-24T21:50:13.491 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-12-24T21:50:13.585 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-12-24T21:50:13.587 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-12-24T21:50:13.704 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-12-24T21:50:13.847 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-12-24T21:50:13.932 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-12-24T21:50:14.049 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-12-24T21:50:14.203 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-12-24T21:50:14.277 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-12-24T21:50:14.413 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-12-24T21:50:14.566 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-12-24T21:50:14.619 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-12-24T21:50:14.746 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-12-24T21:50:14.923 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-12-24T21:50:14.956 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-12-24T21:50:15.093 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-12-24T21:50:15.285 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-12-24T21:50:15.309 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-12-24T21:50:15.415 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-12-24T21:50:15.603 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-12-24T21:50:15.635 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-12-24T21:50:15.771 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-12-24T21:50:15.960 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-12-24T21:50:15.992 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-12-24T21:50:16.098 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-12-24T21:50:16.311 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-12-24T21:50:16.327 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-12-24T21:50:16.413 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-12-24T21:50:16.641 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-12-24T21:50:16.646 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-12-24T21:50:16.724 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-12-24T21:50:16.725 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-24T21:50:16.986 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-12-24T21:50:16.987 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-12-24T21:50:17.040 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-12-24T21:50:17.292 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-12-24T21:50:17.324 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-12-24T21:50:17.357 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-12-24T21:50:17.645 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-12-24T21:50:17.656 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2019-12-24T21:50:17.657 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-12-24T21:50:17.995 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-12-24T21:50:18.007 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-12-24T21:50:18.032 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2019-12-24T21:50:18.130 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:18 +0000 (0:00:34.276) 0:01:27.019 ****** 2019-12-24T21:50:18.170 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-24T21:50:18.172 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:18.182 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:18.193 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:18.194 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:18.205 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:18.216 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was Fa 2019-12-24T21:50:18.217 INFO:teuthology.task.ansible.out:lse"} 2019-12-24T21:50:18.228 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:18.230 INFO:teuthology.task.ansible.out: 2019-12-24T21:50:18.240 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:18.241 INFO:teuthology.task.ansible.out: 2019-12-24T21:50:18.345 INFO:teuthology.task.ansible.out: 2019-12-24T21:50:18.347 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsriva 2019-12-24T21:50:18.348 INFO:teuthology.task.ansible.out:s@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-24T21:50:18.373 INFO:teuthology.task.ansible.out: 2019-12-24T21:50:18.376 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-24T21:50:18.377 INFO:teuthology.task.ansible.out: skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:18.379 INFO:teuthology.task.ansible.out: 2019-12-24T21:50:18.382 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-24T21:50:18.383 INFO:teuthology.task.ansible.out: ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-12-24T21:50:18.664 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-12-24T21:50:18.719 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-12-24T21:50:18.721 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm 2019-12-24T21:50:18.722 INFO:teuthology.task.ansible.out:", "validate_certs": true} 2019-12-24T21:50:18.730 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:19.012 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-24T21:50:19.013 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-12-24T21:50:19.055 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-24T21:50:19.056 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-12-24T21:50:19.076 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-24T21:50:19.078 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-12-24T21:50:19.371 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2019-12-24T21:50:19.392 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-24T21:50:19.394 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-12-24T21:50:19.425 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-24T21:50:19.426 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-12-24T21:50:19.730 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2019-12-24T21:50:19.741 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-24T21:50:19.743 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-12-24T21:50:19.780 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-24T21:50:19.842 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-24T21:50:19.844 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": true 2019-12-24T21:50:19.845 INFO:teuthology.task.ansible.out:, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name" 2019-12-24T21:50:19.847 INFO:teuthology.task.ansible.out:: "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:19.848 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:19.850 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:19.850 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c0125 2019-12-24T21:50:19.851 INFO:teuthology.task.ansible.out:8aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:19.889 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:19 +0000 (0:00:01.758) 0:01:28.777 ****** 2019-12-24T21:50:19.896 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:19.898 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:19.899 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:19.914 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:19.915 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:19.926 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:19.937 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:19.948 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:19.959 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:19.970 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:19.981 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:19.992 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.003 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.014 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.026 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.037 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.038 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.049 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.060 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.071 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.074 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.075 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.076 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.192 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.194 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.207 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.208 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.209 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.211 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.212 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.214 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2019-12-24T21:50:20.215 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-24T21:50:20.215 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.217 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.238 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-24T21:50:20.269 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-24T21:50:20.270 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.270 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.272 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.273 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.273 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.275 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.276 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.278 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.279 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.321 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:20 +0000 (0:00:00.431) 0:01:29.209 ****** 2019-12-24T21:50:20.328 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.329 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.331 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.331 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.333 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.348 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.349 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.361 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.372 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.379 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.386 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.387 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.398 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.399 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.401 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.402 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.413 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.419 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.426 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.427 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.428 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.440 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.446 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.452 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.453 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.464 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.490 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-12-24T21:50:20.491 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.492 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.514 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.514 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.516 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.527 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.538 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.539 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.550 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.561 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.572 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.583 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.594 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.596 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.607 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.619 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.682 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:20 +0000 (0:00:00.361) 0:01:29.571 ****** 2019-12-24T21:50:20.711 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-12-24T21:50:20.712 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.750 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:20 +0000 (0:00:00.067) 0:01:29.638 ****** 2019-12-24T21:50:20.811 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-24T21:50:20.812 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-12-24T21:50:20.823 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:20.847 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-12-24T21:50:21.089 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-24T21:50:21.091 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-12-24T21:50:21.163 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-24T21:50:21.166 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-12-24T21:50:21.186 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-12-24T21:50:21.420 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-24T21:50:21.422 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-12-24T21:50:21.529 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-24T21:50:21.531 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-12-24T21:50:21.543 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-12-24T21:50:21.544 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.558 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.569 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.569 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.580 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.598 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.600 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.614 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.615 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.626 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.644 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.648 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.659 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.660 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.671 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.693 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.695 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.706 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.707 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.718 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.740 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.741 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.752 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi124.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-12-24T21:50:21.753 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-24T21:50:21.754 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.755 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.765 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.776 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.787 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.798 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.800 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.811 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.822 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.823 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.834 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.845 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.857 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.858 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.869 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.880 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-12-24T21:50:21.882 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.893 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.893 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.895 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.906 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.906 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.917 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.918 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.919 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.930 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.931 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.943 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.945 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.955 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.956 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.957 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.968 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.968 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.970 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.980 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.981 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.982 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:21.992 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.003 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.004 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.006 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.017 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.017 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.019 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.029 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.030 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.031 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.042 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.043 INFO:teuthology.task.ansible.out: 2019-12-24T21:50:22.054 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.055 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.056 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.067 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.067 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.069 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** 2019-12-24T21:50:22.069 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-12-24T21:50:22.070 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.081 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.082 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.092 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.093 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.095 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.107 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.109 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.120 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.122 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.123 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.134 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.134 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.136 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.157 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.158 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.159 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.173 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.182 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.183 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.184 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.194 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.196 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.197 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.199 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.209 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.210 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.212 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.222 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.223 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.224 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.234 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.236 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.236 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.249 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.250 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.252 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.267 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.269 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.281 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.283 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.284 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.286 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.297 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.299 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.299 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.300 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.311 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.313 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.325 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.326 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.328 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.338 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.339 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.341 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.355 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.356 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.377 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.378 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.379 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.419 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:22 +0000 (0:00:01.669) 0:01:31.308 ****** 2019-12-24T21:50:22.426 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.427 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.429 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.429 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-24T21:50:22.430 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-12-24T21:50:22.432 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.445 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.446 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.469 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.512 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:22 +0000 (0:00:00.092) 0:01:31.400 ****** 2019-12-24T21:50:22.521 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-24T21:50:22.522 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.523 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.525 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.525 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.527 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.538 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.540 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.561 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.562 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.573 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.585 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.599 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.615 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.624 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.637 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.638 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.660 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.661 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.672 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.683 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.695 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.707 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.721 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.732 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.755 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.756 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi124.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.766 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.818 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:22 +0000 (0:00:00.306) 0:01:31.707 ****** 2019-12-24T21:50:22.846 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-24T21:50:22.847 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-12-24T21:50:22.848 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:22.885 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:22 +0000 (0:00:00.066) 0:01:31.774 ****** 2019-12-24T21:50:23.102 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-24T21:50:23.103 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-12-24T21:50:23.197 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-12-24T21:50:23.267 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-12-24T21:50:23.454 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-12-24T21:50:23.550 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-12-24T21:50:23.609 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-12-24T21:50:23.757 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-12-24T21:50:23.896 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-12-24T21:50:23.931 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-12-24T21:50:24.116 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-12-24T21:50:24.231 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-12-24T21:50:24.254 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-12-24T21:50:24.438 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-12-24T21:50:24.567 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-12-24T21:50:24.579 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-12-24T21:50:24.778 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-12-24T21:50:24.894 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-12-24T21:50:24.895 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-12-24T21:50:25.116 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-12-24T21:50:25.201 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-12-24T21:50:25.202 INFO:teuthology.task.ansible.out: 2019-12-24T21:50:25.236 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-12-24T21:50:25.438 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-12-24T21:50:25.545 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-12-24T21:50:25.589 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-12-24T21:50:25.749 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-12-24T21:50:25.866 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-12-24T21:50:25.911 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-12-24T21:50:26.039 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-12-24T21:50:26.218 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-12-24T21:50:26.273 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-12-24T21:50:26.347 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-12-24T21:50:26.540 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-12-24T21:50:26.604 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-12-24T21:50:26.680 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-12-24T21:50:26.868 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-12-24T21:50:26.959 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-12-24T21:50:27.005 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-12-24T21:50:27.193 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-12-24T21:50:27.288 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-12-24T21:50:27.320 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-12-24T21:50:27.555 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-12-24T21:50:27.622 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-12-24T21:50:27.634 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-12-24T21:50:27.888 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-12-24T21:50:27.993 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-12-24T21:50:28.152 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jj", "name": "jj", "remove": false, "state": "absent"} 2019-12-24T21:50:28.226 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-12-24T21:50:28.331 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-12-24T21:50:28.555 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-12-24T21:50:28.680 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-12-24T21:50:28.764 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "amarangone", "name": "amarangone", "remove": false, "state": "absent"} 2019-12-24T21:50:28.890 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-12-24T21:50:29.015 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-12-24T21:50:29.224 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-12-24T21:50:29.342 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "oprypin", "name": "oprypin", "remove": false, "state": "absent"} 2019-12-24T21:50:29.364 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-12-24T21:50:29.544 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-12-24T21:50:29.713 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-12-24T21:50:29.921 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adamyanova", "name": "adamyanova", "remove": false, "state": "absent"} 2019-12-24T21:50:30.026 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-12-24T21:50:30.111 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jj", "name": "jj", "remove": false, "state": "absent"} 2019-12-24T21:50:30.529 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sbillah", "name": "sbillah", "remove": false, "state": "absent"} 2019-12-24T21:50:30.613 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jj", "name": "jj", "remove": false, "state": "absent"} 2019-12-24T21:50:30.635 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "amarangone", "name": "amarangone", "remove": false, "state": "absent"} 2019-12-24T21:50:31.065 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "onyb", "name": "onyb", "remove": false, "state": "absent"} 2019-12-24T21:50:31.191 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "amarangone", "name": "amarangone", "remove": false, "state": "absent"} 2019-12-24T21:50:31.203 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "oprypin", "name": "oprypin", "remove": false, "state": "absent"} 2019-12-24T21:50:31.644 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jwilliamson", "name": "jwilliamson", "remove": false, "state": "absent"} 2019-12-24T21:50:31.793 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adamyanova", "name": "adamyanova", "remove": false, "state": "absent"} 2019-12-24T21:50:31.825 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "oprypin", "name": "oprypin", "remove": false, "state": "absent"} 2019-12-24T21:50:32.243 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "kmroz", "name": "kmroz", "remove": false, "state": "absent"} 2019-12-24T21:50:32.352 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sbillah", "name": "sbillah", "remove": false, "state": "absent"} 2019-12-24T21:50:32.364 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adamyanova", "name": "adamyanova", "remove": false, "state": "absent"} 2019-12-24T21:50:32.856 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "shehbazj", "name": "shehbazj", "remove": false, "state": "absent"} 2019-12-24T21:50:32.868 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "onyb", "name": "onyb", "remove": false, "state": "absent"} 2019-12-24T21:50:32.921 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sbillah", "name": "sbillah", "remove": false, "state": "absent"} 2019-12-24T21:50:33.401 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "remove": false, "state": "absent"} 2019-12-24T21:50:33.475 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jwilliamson", "name": "jwilliamson", "remove": false, "state": "absent"} 2019-12-24T21:50:33.497 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "onyb", "name": "onyb", "remove": false, "state": "absent"} 2019-12-24T21:50:33.998 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "asheplyakov", "name": "asheplyakov", "remove": false, "state": "absent"} 2019-12-24T21:50:34.082 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jwilliamson", "name": "jwilliamson", "remove": false, "state": "absent"} 2019-12-24T21:50:34.201 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "kmroz", "name": "kmroz", "remove": false, "state": "absent"} 2019-12-24T21:50:34.587 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "liupan", "name": "liupan", "remove": false, "state": "absent"} 2019-12-24T21:50:34.595 INFO:teuthology.task.ansible.out: 2019-12-24T21:50:34.597 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "kmroz", "name": "kmroz", "remove": false, "state": "absent"} 2019-12-24T21:50:34.598 INFO:teuthology.task.ansible.out: 2019-12-24T21:50:34.745 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "shehbazj", "name": "shehbazj", "remove": false, "state": "absent"} 2019-12-24T21:50:34.881 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-12-24T21:50:35.211 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-12-24T21:50:35.236 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "shehbazj", "name": "shehbazj", "remove": false, "state": "absent"} 2019-12-24T21:50:35.269 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "remove": false, "state": "absent"} 2019-12-24T21:50:35.554 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-12-24T21:50:35.838 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "asheplyakov", "name": "asheplyakov", "remove": false, "state": "absent"} 2019-12-24T21:50:35.860 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "remove": false, "state": "absent"} 2019-12-24T21:50:35.882 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-12-24T21:50:36.198 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-12-24T21:50:36.420 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "asheplyakov", "name": "asheplyakov", "remove": false, "state": "absent"} 2019-12-24T21:50:36.473 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "liupan", "name": "liupan", "remove": false, "state": "absent"} 2019-12-24T21:50:36.506 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-12-24T21:50:36.804 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-12-24T21:50:36.848 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-12-24T21:50:36.980 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "liupan", "name": "liupan", "remove": false, "state": "absent"} 2019-12-24T21:50:37.137 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-12-24T21:50:37.299 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-12-24T21:50:37.469 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "fche", "name": "fche", "remove": false, "state": "absent"} 2019-12-24T21:50:37.498 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-12-24T21:50:37.545 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:37 +0000 (0:00:14.659) 0:01:46.433 ****** 2019-12-24T21:50:37.638 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-12-24T21:50:37.841 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-12-24T21:50:37.983 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-12-24T21:50:38.194 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-12-24T21:50:38.327 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-12-24T21:50:38.539 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-12-24T21:50:38.583 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-12-24T21:50:38.584 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"changed": true, "checksum": "bcb7fb0987df16cc4ec0eb20567ca03f52e167d8", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "66384b595a953a298cfd60e4301d14e6", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577224237.57-249470951735912/source", "state": "file", "uid": 0} 2019-12-24T21:50:38.622 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:38 +0000 (0:00:01.077) 0:01:47.511 ****** 2019-12-24T21:50:38.649 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-12-24T21:50:38.650 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => { "msg": "Host smithi124.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-12-24T21:50:38.688 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:38 +0000 (0:00:00.065) 0:01:47.576 ****** 2019-12-24T21:50:38.694 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-24T21:50:38.695 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-12-24T21:50:38.720 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-12-24T21:50:38.722 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-12-24T21:50:38.758 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:38 +0000 (0:00:00.069) 0:01:47.646 ****** 2019-12-24T21:50:38.786 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-12-24T21:50:38.787 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:38.823 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:38 +0000 (0:00:00.064) 0:01:47.711 ****** 2019-12-24T21:50:38.860 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-24T21:50:38.862 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-12-24T21:50:39.017 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-12-24T21:50:39.248 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-12-24T21:50:39.249 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.097847", "end": "2019-12-24 21:50:39.215812", "rc": 0, "start": "2019-12-24 21:50:39.117965", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-12-24T21:50:39.288 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:39 +0000 (0:00:00.465) 0:01:48.177 ****** 2019-12-24T21:50:39.314 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-12-24T21:50:39.315 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:39.353 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:39 +0000 (0:00:00.064) 0:01:48.241 ****** 2019-12-24T21:50:39.357 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-24T21:50:39.358 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-12-24T21:50:39.371 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "fche", "name": "fche", "remove": false, "state": "absent"} 2019-12-24T21:50:39.403 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-12-24T21:50:39.404 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:39.440 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:39 +0000 (0:00:00.087) 0:01:48.329 ****** 2019-12-24T21:50:39.477 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:39 +0000 (0:00:00.036) 0:01:48.366 ****** 2019-12-24T21:50:39.511 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-12-24T21:50:39.512 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:39.549 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:39 +0000 (0:00:00.071) 0:01:48.437 ****** 2019-12-24T21:50:39.585 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-12-24T21:50:39.587 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:39.623 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:39 +0000 (0:00:00.074) 0:01:48.511 ****** 2019-12-24T21:50:39.649 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-12-24T21:50:39.650 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:39.689 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:39 +0000 (0:00:00.066) 0:01:48.578 ****** 2019-12-24T21:50:39.717 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:39.755 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:39 +0000 (0:00:00.065) 0:01:48.643 ****** 2019-12-24T21:50:39.793 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-12-24T21:50:39.794 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-24T21:50:39.795 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-24T21:50:39.832 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:39 +0000 (0:00:00.077) 0:01:48.721 ****** 2019-12-24T21:50:39.858 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-12-24T21:50:39.859 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:39.897 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:39 +0000 (0:00:00.064) 0:01:48.785 ****** 2019-12-24T21:50:39.912 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-24T21:50:39.914 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "fche", "name": "fche", "remove": false, "state": "absent"} 2019-12-24T21:50:39.934 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-12-24T21:50:39.935 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:39.970 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:39 +0000 (0:00:00.072) 0:01:48.858 ****** 2019-12-24T21:50:40.001 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:39 +0000 (0:00:00.031) 0:01:48.890 ****** 2019-12-24T21:50:40.028 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-12-24T21:50:40.030 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-24T21:50:40.063 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:40 +0000 (0:00:00.061) 0:01:48.952 ****** 2019-12-24T21:50:40.099 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-12-24T21:50:40.101 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:40.136 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:40 +0000 (0:00:00.072) 0:01:49.024 ****** 2019-12-24T21:50:40.172 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-12-24T21:50:40.174 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-24T21:50:40.209 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:40 +0000 (0:00:00.072) 0:01:49.097 ****** 2019-12-24T21:50:40.254 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-12-24T21:50:40.256 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:40.296 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:40 +0000 (0:00:00.088) 0:01:49.185 ****** 2019-12-24T21:50:40.325 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:40.359 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:40 +0000 (0:00:00.062) 0:01:49.247 ****** 2019-12-24T21:50:40.385 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-12-24T21:50:40.386 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:40.422 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:40 +0000 (0:00:00.062) 0:01:49.310 ****** 2019-12-24T21:50:40.447 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-12-24T21:50:40.449 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:40.483 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:40 +0000 (0:00:00.061) 0:01:49.372 ****** 2019-12-24T21:50:40.511 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-12-24T21:50:40.513 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-24T21:50:40.547 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:40 +0000 (0:00:00.063) 0:01:49.436 ****** 2019-12-24T21:50:40.573 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-12-24T21:50:40.575 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:40.610 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:40 +0000 (0:00:00.062) 0:01:49.498 ****** 2019-12-24T21:50:40.616 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-12-24T21:50:40.618 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "checksum": "bcb7fb0987df16cc4ec0eb20567ca03f52e167d8", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "66384b595a953a298cfd60e4301d14e6", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577224239.46-46910882029129/source", "state": "file", "uid": 0} 2019-12-24T21:50:40.654 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:40 +0000 (0:00:00.044) 0:01:49.543 ****** 2019-12-24T21:50:40.660 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-12-24T21:50:40.661 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:40.698 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:40 +0000 (0:00:00.043) 0:01:49.586 ****** 2019-12-24T21:50:40.704 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-12-24T21:50:40.704 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => { "msg": "Host smithi037.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-12-24T21:50:40.741 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:40 +0000 (0:00:00.043) 0:01:49.630 ****** 2019-12-24T21:50:40.746 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-12-24T21:50:40.748 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:40.783 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:40 +0000 (0:00:00.042) 0:01:49.672 ****** 2019-12-24T21:50:40.788 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-12-24T21:50:40.788 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-12-24T21:50:40.826 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:40 +0000 (0:00:00.042) 0:01:49.714 ****** 2019-12-24T21:50:40.832 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:40.867 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:40 +0000 (0:00:00.041) 0:01:49.755 ****** 2019-12-24T21:50:40.871 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-12-24T21:50:40.873 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:40.911 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:40 +0000 (0:00:00.044) 0:01:49.799 ****** 2019-12-24T21:50:40.917 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:40.955 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:40 +0000 (0:00:00.043) 0:01:49.842 ****** 2019-12-24T21:50:40.979 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-12-24T21:50:40.981 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:41.016 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:41 +0000 (0:00:00.061) 0:01:49.904 ****** 2019-12-24T21:50:41.052 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-12-24T21:50:41.054 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-24T21:50:41.089 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:41 +0000 (0:00:00.073) 0:01:49.978 ****** 2019-12-24T21:50:41.094 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-12-24T21:50:41.095 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "checksum": "bcb7fb0987df16cc4ec0eb20567ca03f52e167d8", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "66384b595a953a298cfd60e4301d14e6", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577224239.99-93050893617654/source", "state": "file", "uid": 0} 2019-12-24T21:50:41.132 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:41 +0000 (0:00:00.043) 0:01:50.021 ****** 2019-12-24T21:50:41.138 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-12-24T21:50:41.177 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:41 +0000 (0:00:00.044) 0:01:50.066 ****** 2019-12-24T21:50:41.183 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-12-24T21:50:41.183 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => { "msg": "Host smithi006.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-12-24T21:50:41.220 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:41 +0000 (0:00:00.042) 0:01:50.108 ****** 2019-12-24T21:50:41.225 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-12-24T21:50:41.226 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:41.263 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:41 +0000 (0:00:00.042) 0:01:50.151 ****** 2019-12-24T21:50:41.268 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-12-24T21:50:41.269 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-12-24T21:50:41.311 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:41 +0000 (0:00:00.047) 0:01:50.199 ****** 2019-12-24T21:50:41.317 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-12-24T21:50:41.318 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.080139", "end": "2019-12-24 21:50:41.269816", "rc": 0, "start": "2019-12-24 21:50:41.189677", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-12-24T21:50:41.355 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:41 +0000 (0:00:00.044) 0:01:50.244 ****** 2019-12-24T21:50:41.360 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-12-24T21:50:41.362 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:41.398 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:41 +0000 (0:00:00.042) 0:01:50.286 ****** 2019-12-24T21:50:41.404 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-12-24T21:50:41.406 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:41.442 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:41 +0000 (0:00:00.043) 0:01:50.330 ****** 2019-12-24T21:50:41.479 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-12-24T21:50:41.479 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:41.518 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:41 +0000 (0:00:00.073) 0:01:50.403 ****** 2019-12-24T21:50:41.543 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-12-24T21:50:41.544 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:41.578 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:41 +0000 (0:00:00.062) 0:01:50.466 ****** 2019-12-24T21:50:41.605 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-12-24T21:50:41.606 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:41.658 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:41 +0000 (0:00:00.080) 0:01:50.547 ****** 2019-12-24T21:50:41.666 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-12-24T21:50:41.667 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-24T21:50:41.712 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:41 +0000 (0:00:00.053) 0:01:50.600 ****** 2019-12-24T21:50:41.718 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-12-24T21:50:41.719 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:41.758 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:41 +0000 (0:00:00.046) 0:01:50.647 ****** 2019-12-24T21:50:41.796 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-12-24T21:50:41.797 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:41.847 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:41 +0000 (0:00:00.089) 0:01:50.736 ****** 2019-12-24T21:50:41.854 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-12-24T21:50:41.855 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.094885", "end": "2019-12-24 21:50:41.796072", "rc": 0, "start": "2019-12-24 21:50:41.701187", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-12-24T21:50:41.897 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:41 +0000 (0:00:00.049) 0:01:50.785 ****** 2019-12-24T21:50:41.903 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-12-24T21:50:41.904 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-24T21:50:41.906 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-24T21:50:41.951 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:41 +0000 (0:00:00.054) 0:01:50.840 ****** 2019-12-24T21:50:41.958 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-12-24T21:50:41.960 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:41.998 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:41 +0000 (0:00:00.046) 0:01:50.886 ****** 2019-12-24T21:50:42.004 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-12-24T21:50:42.004 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:42.047 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.048) 0:01:50.935 ****** 2019-12-24T21:50:42.055 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-12-24T21:50:42.057 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:42.092 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.044) 0:01:50.980 ****** 2019-12-24T21:50:42.099 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-12-24T21:50:42.100 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:42.137 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.045) 0:01:51.026 ****** 2019-12-24T21:50:42.143 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-12-24T21:50:42.145 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:42.183 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.045) 0:01:51.072 ****** 2019-12-24T21:50:42.190 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-12-24T21:50:42.191 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-24T21:50:42.228 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.044) 0:01:51.117 ****** 2019-12-24T21:50:42.234 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-12-24T21:50:42.235 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:42.279 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.050) 0:01:51.167 ****** 2019-12-24T21:50:42.287 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-12-24T21:50:42.290 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:42.327 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.046) 0:01:51.213 ****** 2019-12-24T21:50:42.331 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-12-24T21:50:42.332 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:42.370 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.044) 0:01:51.258 ****** 2019-12-24T21:50:42.376 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-12-24T21:50:42.377 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-24T21:50:42.414 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.045) 0:01:51.303 ****** 2019-12-24T21:50:42.420 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-12-24T21:50:42.422 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:42.459 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.044) 0:01:51.347 ****** 2019-12-24T21:50:42.464 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-12-24T21:50:42.466 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:42.503 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.044) 0:01:51.392 ****** 2019-12-24T21:50:42.508 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-12-24T21:50:42.509 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-24T21:50:42.511 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-24T21:50:42.548 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.044) 0:01:51.436 ****** 2019-12-24T21:50:42.554 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-12-24T21:50:42.556 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:42.598 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.046) 0:01:51.482 ****** 2019-12-24T21:50:42.602 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-12-24T21:50:42.604 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:42.640 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.045) 0:01:51.528 ****** 2019-12-24T21:50:42.646 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-12-24T21:50:42.647 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:42.684 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.044) 0:01:51.573 ****** 2019-12-24T21:50:42.689 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-12-24T21:50:42.691 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:42.728 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.043) 0:01:51.616 ****** 2019-12-24T21:50:42.736 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-12-24T21:50:42.738 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:42.775 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.046) 0:01:51.663 ****** 2019-12-24T21:50:42.780 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-12-24T21:50:42.782 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-24T21:50:42.819 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.045) 0:01:51.708 ****** 2019-12-24T21:50:42.827 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-12-24T21:50:42.828 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-12-24T21:50:42.830 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-12-24T21:50:42.869 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.049) 0:01:51.757 ****** 2019-12-24T21:50:42.874 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-12-24T21:50:42.876 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:42.914 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.045) 0:01:51.803 ****** 2019-12-24T21:50:42.920 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-12-24T21:50:42.921 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:42.966 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:42 +0000 (0:00:00.051) 0:01:51.855 ****** 2019-12-24T21:50:42.973 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-12-24T21:50:42.973 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-24T21:50:43.012 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.045) 0:01:51.900 ****** 2019-12-24T21:50:43.018 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-12-24T21:50:43.019 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:43.056 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.043) 0:01:51.944 ****** 2019-12-24T21:50:43.064 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-12-24T21:50:43.066 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:43.103 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.047) 0:01:51.992 ****** 2019-12-24T21:50:43.109 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-12-24T21:50:43.110 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:43.155 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.051) 0:01:52.043 ****** 2019-12-24T21:50:43.161 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-12-24T21:50:43.162 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:43.206 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.050) 0:01:52.094 ****** 2019-12-24T21:50:43.211 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-12-24T21:50:43.212 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:43.251 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.044) 0:01:52.139 ****** 2019-12-24T21:50:43.257 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-12-24T21:50:43.258 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:43.296 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.045) 0:01:52.185 ****** 2019-12-24T21:50:43.304 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-12-24T21:50:43.306 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:43.343 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.046) 0:01:52.231 ****** 2019-12-24T21:50:43.351 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:43.394 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.050) 0:01:52.282 ****** 2019-12-24T21:50:43.400 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-12-24T21:50:43.400 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:43.440 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.046) 0:01:52.329 ****** 2019-12-24T21:50:43.446 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-12-24T21:50:43.448 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-24T21:50:43.485 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.044) 0:01:52.373 ****** 2019-12-24T21:50:43.492 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-24T21:50:43.534 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.049) 0:01:52.422 ****** 2019-12-24T21:50:43.540 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-12-24T21:50:43.542 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:43.580 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.046) 0:01:52.469 ****** 2019-12-24T21:50:43.587 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-12-24T21:50:43.625 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.045) 0:01:52.514 ****** 2019-12-24T21:50:43.632 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-12-24T21:50:43.633 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:43.680 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.054) 0:01:52.568 ****** 2019-12-24T21:50:43.686 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-12-24T21:50:43.688 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:43.731 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.051) 0:01:52.619 ****** 2019-12-24T21:50:43.737 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-12-24T21:50:43.739 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:43.740 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** ok: [smithi124.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-12-24T21:50:43.782 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.050) 0:01:52.670 ****** 2019-12-24T21:50:43.816 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.033) 0:01:52.704 ****** 2019-12-24T21:50:43.821 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:43.859 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.043) 0:01:52.747 ****** 2019-12-24T21:50:43.895 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-12-24T21:50:43.897 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:43.932 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.073) 0:01:52.821 ****** 2019-12-24T21:50:43.962 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-12-24T21:50:43.963 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:43.998 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:43 +0000 (0:00:00.065) 0:01:52.886 ****** 2019-12-24T21:50:44.025 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-12-24T21:50:44.027 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-24T21:50:44.062 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:44 +0000 (0:00:00.063) 0:01:52.950 ****** 2019-12-24T21:50:44.089 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-12-24T21:50:44.124 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:44 +0000 (0:00:00.062) 0:01:53.013 ****** 2019-12-24T21:50:44.131 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-12-24T21:50:44.132 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-24T21:50:44.171 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:44 +0000 (0:00:00.046) 0:01:53.060 ****** 2019-12-24T21:50:44.177 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-12-24T21:50:44.179 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:50:44.217 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:44 +0000 (0:00:00.043) 0:01:53.103 ****** 2019-12-24T21:50:44.587 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-12-24T21:50:44.589 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-24T21:50:44.626 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:44 +0000 (0:00:00.410) 0:01:53.514 ****** 2019-12-24T21:50:44.925 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-12-24T21:50:44.926 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577224243.85-10364307250173/source", "state": "file", "uid": 0} 2019-12-24T21:50:45.164 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-12-24T21:50:45.165 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-12-24T21:50:45.622 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-12-24T21:50:45.969 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-12-24T21:50:45.971 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577224244.93-55325681554863/source", "state": "file", "uid": 0} 2019-12-24T21:50:46.011 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:46 +0000 (0:00:01.385) 0:01:54.900 ****** 2019-12-24T21:50:46.102 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-12-24T21:50:46.102 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-12-24T21:50:46.142 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:46 +0000 (0:00:00.130) 0:01:55.031 ****** 2019-12-24T21:50:46.514 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-12-24T21:50:46.576 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-12-24T21:50:46.579 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-12-24T21:50:46.628 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:46 +0000 (0:00:00.485) 0:01:55.516 ****** 2019-12-24T21:50:46.776 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-12-24T21:50:46.776 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-24T21:50:46.778 INFO:teuthology.task.ansible.out: [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually 2019-12-24T21:50:46.831 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:46 +0000 (0:00:00.203) 0:01:55.720 ****** 2019-12-24T21:50:47.340 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-12-24T21:50:47.341 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577224246.18-8262559855184/source", "state": "file", "uid": 0} 2019-12-24T21:50:47.799 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577224246.67-178602607322899/source", "state": "file", "uid": 0} 2019-12-24T21:50:48.496 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577224247.35-270961954481005/source", "state": "file", "uid": 0} 2019-12-24T21:50:48.534 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:48 +0000 (0:00:01.703) 0:01:57.423 ****** 2019-12-24T21:50:48.890 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-12-24T21:50:48.892 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-12-24T21:50:48.981 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-12-24T21:50:48.983 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577224247.82-251433427425776/source", "state": "file", "uid": 0} 2019-12-24T21:50:49.019 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:49 +0000 (0:00:00.484) 0:01:57.908 ****** 2019-12-24T21:50:49.165 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-12-24T21:50:49.166 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-24T21:50:49.204 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:49 +0000 (0:00:00.184) 0:01:58.093 ****** 2019-12-24T21:50:49.368 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-12-24T21:50:49.681 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-24T21:50:49.726 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:50:49 +0000 (0:00:00.522) 0:01:58.615 ****** 2019-12-24T21:51:05.006 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** [WARNING]: Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi124.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:17.859638", "end": "2019-12-24 21:51:04.978886", "rc": 0, "start": "2019-12-24 21:50:47.119248", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: reflector.westga.edu\n * extras: mirror.umd.edu\n * updates: mirror.jaleco.com\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: reflector.westga.edu", " * extras: mirror.umd.edu", " * updates: mirror.jaleco.com", "Metadata Cache Created"]} 2019-12-24T21:51:05.055 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:05 +0000 (0:00:15.328) 0:02:13.944 ****** 2019-12-24T21:51:05.366 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-24T21:51:05.367 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-12-24T21:51:05.675 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-24T21:51:05.713 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:05 +0000 (0:00:00.657) 0:02:14.602 ****** 2019-12-24T21:51:05.740 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-24T21:51:05.742 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:05.779 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:05 +0000 (0:00:00.065) 0:02:14.667 ****** 2019-12-24T21:51:05.806 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-12-24T21:51:05.808 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:05.843 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:05 +0000 (0:00:00.064) 0:02:14.732 ****** 2019-12-24T21:51:05.870 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-12-24T21:51:05.872 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:05.912 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:05 +0000 (0:00:00.068) 0:02:14.800 ****** 2019-12-24T21:51:05.939 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-24T21:51:05.941 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:05.977 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:05 +0000 (0:00:00.064) 0:02:14.865 ****** 2019-12-24T21:51:06.010 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-12-24T21:51:06.012 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:06.049 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:06 +0000 (0:00:00.072) 0:02:14.938 ****** 2019-12-24T21:51:06.076 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-12-24T21:51:06.079 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:06.116 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:06 +0000 (0:00:00.066) 0:02:15.005 ****** 2019-12-24T21:51:06.144 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:06.182 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:06 +0000 (0:00:00.065) 0:02:15.071 ****** 2019-12-24T21:51:06.209 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-12-24T21:51:06.210 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:06.247 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:06 +0000 (0:00:00.065) 0:02:15.136 ****** 2019-12-24T21:51:07.512 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:17.973163", "end": "2019-12-24 21:51:07.484294", "rc": 0, "start": "2019-12-24 21:50:49.511131", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: reflector.westga.edu\n * extras: mirror.umd.edu\n * updates: mirror.jaleco.com\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: reflector.westga.edu", " * extras: mirror.umd.edu", " * updates: mirror.jaleco.com", "Metadata Cache Created"]} 2019-12-24T21:51:07.551 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:07 +0000 (0:00:01.303) 0:02:16.439 ****** 2019-12-24T21:51:07.557 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-12-24T21:51:07.559 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.971460", "end": "2019-12-24 21:51:07.500476", "rc": 0, "start": "2019-12-24 21:51:06.529016", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:51:07.598 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:07 +0000 (0:00:00.046) 0:02:16.486 ****** 2019-12-24T21:51:07.893 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-24T21:51:07.894 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-12-24T21:51:08.207 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-24T21:51:08.257 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:08 +0000 (0:00:00.658) 0:02:17.145 ****** 2019-12-24T21:51:08.276 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-12-24T21:51:08.278 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:18.233949", "end": "2019-12-24 21:51:08.240802", "rc": 0, "start": "2019-12-24 21:50:50.006853", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: reflector.westga.edu\n * extras: mirror.umd.edu\n * updates: mirror.jaleco.com\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: reflector.westga.edu", " * extras: mirror.umd.edu", " * updates: mirror.jaleco.com", "Metadata Cache Created"]} 2019-12-24T21:51:08.280 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-24T21:51:08.281 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:08.322 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:08 +0000 (0:00:00.065) 0:02:17.210 ****** 2019-12-24T21:51:08.368 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:08 +0000 (0:00:00.045) 0:02:17.256 ****** 2019-12-24T21:51:08.397 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-12-24T21:51:08.399 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:08.435 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:08 +0000 (0:00:00.067) 0:02:17.324 ****** 2019-12-24T21:51:08.462 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-12-24T21:51:08.464 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:08.500 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:08 +0000 (0:00:00.064) 0:02:17.389 ****** 2019-12-24T21:51:08.507 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-12-24T21:51:08.508 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-12-24T21:51:08.546 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:08 +0000 (0:00:00.046) 0:02:17.435 ****** 2019-12-24T21:51:08.553 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-24T21:51:08.555 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:08.593 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:08 +0000 (0:00:00.045) 0:02:17.481 ****** 2019-12-24T21:51:08.598 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-12-24T21:51:08.600 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:08.639 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:08 +0000 (0:00:00.046) 0:02:17.527 ****** 2019-12-24T21:51:08.652 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:08.687 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:08 +0000 (0:00:00.045) 0:02:17.573 ****** 2019-12-24T21:51:08.691 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-12-24T21:51:08.693 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:08.731 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:08 +0000 (0:00:00.046) 0:02:17.619 ****** 2019-12-24T21:51:08.738 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-12-24T21:51:08.740 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:08.782 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:08 +0000 (0:00:00.050) 0:02:17.670 ****** 2019-12-24T21:51:08.789 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-12-24T21:51:08.791 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:08.827 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:08 +0000 (0:00:00.045) 0:02:17.715 ****** 2019-12-24T21:51:08.833 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-12-24T21:51:08.835 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:08.875 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:08 +0000 (0:00:00.044) 0:02:17.760 ****** 2019-12-24T21:51:08.880 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-12-24T21:51:08.882 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:08.916 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:08 +0000 (0:00:00.044) 0:02:17.804 ****** 2019-12-24T21:51:08.922 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-12-24T21:51:08.924 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:08.961 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:08 +0000 (0:00:00.045) 0:02:17.850 ****** 2019-12-24T21:51:09.043 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-24T21:51:09.044 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-24T21:51:09.092 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:09 +0000 (0:00:00.130) 0:02:17.980 ****** 2019-12-24T21:51:09.119 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-24T21:51:09.121 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:09.160 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:09 +0000 (0:00:00.068) 0:02:18.048 ****** 2019-12-24T21:51:09.187 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-12-24T21:51:09.188 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:09.224 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:09 +0000 (0:00:00.064) 0:02:18.113 ****** 2019-12-24T21:51:09.251 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-12-24T21:51:09.253 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:09.289 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:09 +0000 (0:00:00.063) 0:02:18.177 ****** 2019-12-24T21:51:09.316 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-24T21:51:09.317 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:09.353 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:09 +0000 (0:00:00.064) 0:02:18.241 ****** 2019-12-24T21:51:09.379 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-12-24T21:51:09.381 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:09.415 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:09 +0000 (0:00:00.062) 0:02:18.303 ****** 2019-12-24T21:51:09.442 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-12-24T21:51:09.443 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:09.480 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:09 +0000 (0:00:00.065) 0:02:18.369 ****** 2019-12-24T21:51:09.506 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-12-24T21:51:09.508 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:09.558 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:09 +0000 (0:00:00.077) 0:02:18.446 ****** 2019-12-24T21:51:09.596 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-12-24T21:51:09.598 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:09.640 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:09 +0000 (0:00:00.081) 0:02:18.528 ****** 2019-12-24T21:51:09.826 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-12-24T21:51:09.827 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-12-24T21:51:09.875 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:09 +0000 (0:00:00.235) 0:02:18.763 ****** 2019-12-24T21:51:10.535 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-12-24T21:51:10.536 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.257291", "end": "2019-12-24 21:51:10.500437", "rc": 0, "start": "2019-12-24 21:51:09.243146", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:51:10.537 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.543777", "end": "2019-12-24 21:51:10.500488", "rc": 0, "start": "2019-12-24 21:51:09.956711", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:51:10.578 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:10 +0000 (0:00:00.703) 0:02:19.467 ****** 2019-12-24T21:51:10.623 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:10 +0000 (0:00:00.044) 0:02:19.511 ****** 2019-12-24T21:51:11.080 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-12-24T21:51:11.080 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-12-24T21:51:11.118 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:11 +0000 (0:00:00.495) 0:02:20.007 ****** 2019-12-24T21:51:11.145 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-12-24T21:51:11.147 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:11.184 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:11 +0000 (0:00:00.065) 0:02:20.073 ****** 2019-12-24T21:51:11.191 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-12-24T21:51:11.191 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-12-24T21:51:11.230 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:11 +0000 (0:00:00.045) 0:02:20.118 ****** 2019-12-24T21:51:11.236 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-12-24T21:51:11.238 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:11.275 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:11 +0000 (0:00:00.044) 0:02:20.163 ****** 2019-12-24T21:51:11.282 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-12-24T21:51:11.284 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:11.322 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:11 +0000 (0:00:00.047) 0:02:20.210 ****** 2019-12-24T21:51:11.332 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:11.369 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:11 +0000 (0:00:00.046) 0:02:20.257 ****** 2019-12-24T21:51:11.375 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-12-24T21:51:11.376 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:11.416 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:11 +0000 (0:00:00.047) 0:02:20.305 ****** 2019-12-24T21:51:11.422 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-12-24T21:51:11.423 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:11.464 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:11 +0000 (0:00:00.048) 0:02:20.353 ****** 2019-12-24T21:51:11.470 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-12-24T21:51:11.472 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:11.510 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:11 +0000 (0:00:00.045) 0:02:20.399 ****** 2019-12-24T21:51:11.537 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-12-24T21:51:11.539 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:11.575 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:11 +0000 (0:00:00.065) 0:02:20.464 ****** 2019-12-24T21:51:12.594 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-12-24T21:51:12.594 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-12-24T21:51:12.596 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-12-24T21:51:12.639 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:12 +0000 (0:00:01.063) 0:02:21.528 ****** 2019-12-24T21:51:12.687 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:12 +0000 (0:00:00.047) 0:02:21.575 ****** 2019-12-24T21:51:14.026 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-12-24T21:51:14.027 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-12-24T21:51:14.078 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:14 +0000 (0:00:01.391) 0:02:22.967 ****** 2019-12-24T21:51:15.023 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-24T21:51:15.023 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-12-24T21:51:15.937 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-12-24T21:51:16.651 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-12-24T21:51:16.653 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-12-24T21:51:16.697 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:16 +0000 (0:00:02.618) 0:02:25.585 ****** 2019-12-24T21:51:16.724 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-12-24T21:51:16.762 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:16 +0000 (0:00:00.064) 0:02:25.650 ****** 2019-12-24T21:51:16.779 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-24T21:51:16.780 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-12-24T21:51:16.820 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:16 +0000 (0:00:00.058) 0:02:25.708 ****** 2019-12-24T21:51:17.136 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-24T21:51:17.172 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:17 +0000 (0:00:00.352) 0:02:26.061 ****** 2019-12-24T21:51:17.674 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-24T21:51:17.676 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-12-24T21:51:17.719 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-12-24T21:51:18.058 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-24T21:51:18.060 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-12-24T21:51:18.632 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi006.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-12-24T21:51:18.680 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-12-24T21:51:18.897 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-24T21:51:18.899 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-12-24T21:51:19.470 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-24T21:51:19.472 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-12-24T21:51:19.536 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:19 +0000 (0:00:02.363) 0:02:28.424 ****** 2019-12-24T21:51:19.575 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-12-24T21:51:19.617 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:19 +0000 (0:00:00.081) 0:02:28.505 ****** 2019-12-24T21:51:19.740 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-24T21:51:19.741 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-12-24T21:51:19.782 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:19 +0000 (0:00:00.165) 0:02:28.671 ****** 2019-12-24T21:51:19.809 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-12-24T21:51:19.811 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:19.848 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:19 +0000 (0:00:00.065) 0:02:28.736 ****** 2019-12-24T21:51:19.865 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-12-24T21:51:19.866 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-24T21:51:19.904 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:19 +0000 (0:00:00.056) 0:02:28.792 ****** 2019-12-24T21:51:19.912 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-12-24T21:51:19.913 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-12-24T21:51:19.952 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:19 +0000 (0:00:00.047) 0:02:28.840 ****** 2019-12-24T21:51:19.958 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-12-24T21:51:19.959 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-24T21:51:20.000 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:19 +0000 (0:00:00.048) 0:02:28.889 ****** 2019-12-24T21:51:20.269 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-12-24T21:51:20.271 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-12-24T21:51:20.306 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:20 +0000 (0:00:00.305) 0:02:29.194 ****** 2019-12-24T21:51:20.354 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-12-24T21:51:20.356 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-24T21:51:20.366 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-24T21:51:20.377 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-24T21:51:20.399 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-24T21:51:20.437 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:20 +0000 (0:00:00.130) 0:02:29.325 ****** 2019-12-24T21:51:20.780 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-24T21:51:20.781 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-12-24T21:51:20.921 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-12-24T21:51:21.647 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-12-24T21:51:21.830 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-12-24T21:51:22.536 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-12-24T21:51:22.579 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:22 +0000 (0:00:02.141) 0:02:31.467 ****** 2019-12-24T21:51:22.607 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-12-24T21:51:22.610 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:22.653 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:22 +0000 (0:00:00.074) 0:02:31.541 ****** 2019-12-24T21:51:22.706 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-12-24T21:51:22.708 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi037.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-12-24T21:51:22.749 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:22 +0000 (0:00:00.095) 0:02:31.637 ****** 2019-12-24T21:51:22.788 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:22 +0000 (0:00:00.039) 0:02:31.677 ****** 2019-12-24T21:51:22.816 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-12-24T21:51:22.818 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:22.854 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:22 +0000 (0:00:00.065) 0:02:31.742 ****** 2019-12-24T21:51:22.893 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-12-24T21:51:22.931 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:22 +0000 (0:00:00.077) 0:02:31.819 ****** 2019-12-24T21:51:23.068 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-12-24T21:51:23.070 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-12-24T21:51:23.108 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:23 +0000 (0:00:00.177) 0:02:31.997 ****** 2019-12-24T21:51:23.147 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-12-24T21:51:23.149 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-24T21:51:23.169 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-24T21:51:23.180 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-24T21:51:23.195 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-24T21:51:23.230 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:23 +0000 (0:00:00.121) 0:02:32.119 ****** 2019-12-24T21:51:23.258 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-12-24T21:51:23.259 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-12-24T21:51:23.297 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:23 +0000 (0:00:00.066) 0:02:32.185 ****** 2019-12-24T21:51:23.345 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-12-24T21:51:23.347 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-24T21:51:23.356 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-24T21:51:23.368 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-24T21:51:23.380 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-24T21:51:23.418 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:23 +0000 (0:00:00.121) 0:02:32.307 ****** 2019-12-24T21:51:23.784 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-12-24T21:51:23.785 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-12-24T21:51:23.824 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:23 +0000 (0:00:00.405) 0:02:32.713 ****** 2019-12-24T21:51:23.851 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-12-24T21:51:23.852 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:23.890 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:23 +0000 (0:00:00.065) 0:02:32.778 ****** 2019-12-24T21:51:24.827 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-12-24T21:51:24.828 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-12-24T21:51:24.871 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:24 +0000 (0:00:00.981) 0:02:33.759 ****** 2019-12-24T21:51:25.735 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-12-24T21:51:25.736 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-12-24T21:51:25.775 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:25 +0000 (0:00:00.903) 0:02:34.663 ****** 2019-12-24T21:51:25.801 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-12-24T21:51:25.803 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:25.839 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:25 +0000 (0:00:00.064) 0:02:34.727 ****** 2019-12-24T21:51:26.158 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-12-24T21:51:26.159 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-24T21:51:26.200 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:26 +0000 (0:00:00.360) 0:02:35.088 ****** 2019-12-24T21:51:26.542 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-12-24T21:51:26.543 INFO:teuthology.task.ansible.out:fatal: [smithi124.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-12-24T21:51:26.582 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:26 +0000 (0:00:00.382) 0:02:35.470 ****** 2019-12-24T21:51:26.612 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-12-24T21:51:26.614 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:26.651 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:26 +0000 (0:00:00.069) 0:02:35.539 ****** 2019-12-24T21:51:26.710 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-12-24T21:51:26.712 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-12-24T21:51:26.759 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:26 +0000 (0:00:00.108) 0:02:35.647 ****** 2019-12-24T21:51:26.797 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:26.836 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:26 +0000 (0:00:00.076) 0:02:35.724 ****** 2019-12-24T21:51:26.843 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-12-24T21:51:26.844 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-12-24T21:51:26.886 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:26 +0000 (0:00:00.050) 0:02:35.775 ****** 2019-12-24T21:51:26.913 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-12-24T21:51:26.915 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:26.958 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:26 +0000 (0:00:00.071) 0:02:35.846 ****** 2019-12-24T21:51:27.580 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-12-24T21:51:27.581 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-12-24T21:51:27.620 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:27 +0000 (0:00:00.661) 0:02:36.508 ****** 2019-12-24T21:51:27.775 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-12-24T21:51:27.776 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-12-24T21:51:27.814 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:27 +0000 (0:00:00.193) 0:02:36.703 ****** 2019-12-24T21:51:27.898 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-12-24T21:51:27.945 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:27 +0000 (0:00:00.130) 0:02:36.833 ****** 2019-12-24T21:51:28.504 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-12-24T21:51:28.506 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2019-12-24 21:48:33 UTC", "ActiveEnterTimestampMonotonic": "21990061", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target systemd-journald.socket network.target local-fs.target var-run.mount time-sync.target basic.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Tue 2019-12-24 21:48:33 UTC", "AssertTimestampMonotonic": "21988908", "Before": "xdm.service shutdown.target multi-user.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2019-12-24 21:48:33 UTC", "ConditionTimestampMonotonic": "21988907", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8964", "ExecMainStartTimestamp": "Tue 2019-12-24 21:48:33 UTC", "ExecMainStartTimestampMonotonic": "21989575", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-12-24T21:51:28.507 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Tue 2019-12-24 21:48:33 UTC] ; stop_time=[n/a] ; pid=8964 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2019-12-24 21:48:33 UTC", "InactiveExitTimestampMonotonic": "21990061", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8964", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "network-online.target basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-12-24T21:51:28.509 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Tue 2019-12-24 21:48:33 UTC", "WatchdogTimestampMonotonic": "21990034", "WatchdogUSec": "0"}} 2019-12-24T21:51:28.547 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:28 +0000 (0:00:00.602) 0:02:37.435 ****** 2019-12-24T21:51:28.740 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-12-24T21:51:28.741 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-12-24T21:51:28.799 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:28 +0000 (0:00:00.251) 0:02:37.687 ****** 2019-12-24T21:51:28.840 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-12-24T21:51:28.841 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:28.899 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:28 +0000 (0:00:00.099) 0:02:37.787 ****** 2019-12-24T21:51:28.907 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-12-24T21:51:28.909 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004679", "end": "2019-12-24 21:51:28.849679", "rc": 0, "start": "2019-12-24 21:51:28.845000", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-12-24T21:51:28.909 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-12-24T21:51:28.911 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-12-24T21:51:28.951 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:28 +0000 (0:00:00.051) 0:02:37.839 ****** 2019-12-24T21:51:28.989 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:28 +0000 (0:00:00.037) 0:02:37.877 ****** 2019-12-24T21:51:28.995 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-12-24T21:51:28.997 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:29.034 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:29 +0000 (0:00:00.045) 0:02:37.922 ****** 2019-12-24T21:51:29.218 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-12-24T21:51:29.220 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-24T21:51:29.257 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:29 +0000 (0:00:00.222) 0:02:38.145 ****** 2019-12-24T21:51:29.368 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-24T21:51:29.406 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:29 +0000 (0:00:00.149) 0:02:38.295 ****** 2019-12-24T21:51:29.475 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-12-24T21:51:29.477 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-12-24T21:51:29.513 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:29 +0000 (0:00:00.106) 0:02:38.401 ****** 2019-12-24T21:51:29.624 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-12-24T21:51:29.624 INFO:teuthology.task.ansible.out:fatal: [smithi006.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-12-24T21:51:29.663 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:29 +0000 (0:00:00.149) 0:02:38.551 ****** 2019-12-24T21:51:29.689 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-12-24T21:51:29.691 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:29.727 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:29 +0000 (0:00:00.063) 0:02:38.615 ****** 2019-12-24T21:51:29.775 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-12-24T21:51:29.777 INFO:teuthology.task.ansible.out:fatal: [smithi037.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-12-24T21:51:29.815 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:29 +0000 (0:00:00.088) 0:02:38.704 ****** 2019-12-24T21:51:29.854 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-12-24T21:51:29.856 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:51:29.893 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:29 +0000 (0:00:00.077) 0:02:38.781 ****** 2019-12-24T21:51:30.691 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-12-24T21:51:30.692 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-12-24T21:51:30.745 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:30 +0000 (0:00:00.852) 0:02:39.633 ****** 2019-12-24T21:51:30.823 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-12-24T21:51:30.870 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:30 +0000 (0:00:00.124) 0:02:39.758 ****** 2019-12-24T21:51:31.191 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-12-24T21:51:31.193 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2019-12-24 21:48:11 UTC", "ActiveEnterTimestampMonotonic": "21906891", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket local-fs.target var-run.mount system.slice network.target basic.target nss-lookup.target time-sync.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Tue 2019-12-24 21:48:11 UTC", "AssertTimestampMonotonic": "21905976", "Before": "shutdown.target multi-user.target getty@tty1.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2019-12-24 21:48:11 UTC", "ConditionTimestampMonotonic": "21905976", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8724", "ExecMainStartTimestamp": "Tue 2019-12-24 21:48:11 UTC", "ExecMainStartTimestampMonotonic": "21906801", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-12-24T21:51:31.194 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Tue 2019-12-24 21:48:11 UTC] ; stop_time=[n/a] ; pid=8724 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2019-12-24 21:48:11 UTC", "InactiveExitTimestampMonotonic": "21906891", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8724", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "network-online.target basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-12-24T21:51:31.196 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Tue 2019-12-24 21:48:11 UTC", "WatchdogTimestampMonotonic": "21906858", "WatchdogUSec": "0"}} 2019-12-24T21:51:31.235 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:31 +0000 (0:00:00.365) 0:02:40.124 ****** 2019-12-24T21:51:31.323 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2019-12-24 21:48:10 UTC", "ActiveEnterTimestampMonotonic": "20133772", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target var-run.mount nss-lookup.target basic.target time-sync.target systemd-journald.socket network.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Tue 2019-12-24 21:48:10 UTC", "AssertTimestampMonotonic": "20133243", "Before": "multi-user.target getty@tty1.service xdm.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2019-12-24 21:48:10 UTC", "ConditionTimestampMonotonic": "20133242", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8727", "ExecMainStartTimestamp": "Tue 2019-12-24 21:48:10 UTC", "ExecMainStartTimestampMonotonic": "20133723", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-12-24T21:51:31.324 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Tue 2019-12-24 21:48:10 UTC] ; stop_time=[n/a] ; pid=8727 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2019-12-24 21:48:10 UTC", "InactiveExitTimestampMonotonic": "20133772", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8727", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "network-online.target basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-12-24T21:51:31.326 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Tue 2019-12-24 21:48:10 UTC", "WatchdogTimestampMonotonic": "20133756", "WatchdogUSec": "0"}} 2019-12-24T21:51:31.361 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:31 +0000 (0:00:00.125) 0:02:40.250 ****** 2019-12-24T21:51:31.563 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004005", "end": "2019-12-24 21:51:31.535062", "rc": 0, "start": "2019-12-24 21:51:31.531057", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-12-24T21:51:31.612 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:31 +0000 (0:00:00.250) 0:02:40.501 ****** 2019-12-24T21:51:31.681 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004828", "end": "2019-12-24 21:51:31.658961", "rc": 0, "start": "2019-12-24 21:51:31.654133", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-12-24T21:51:31.720 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:31 +0000 (0:00:00.107) 0:02:40.608 ****** 2019-12-24T21:51:32.114 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-12-24T21:51:32.115 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-12-24T21:51:32.170 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:32 +0000 (0:00:00.450) 0:02:41.059 ****** 2019-12-24T21:51:32.201 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-12-24T21:51:32.252 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:32 +0000 (0:00:00.081) 0:02:41.140 ****** 2019-12-24T21:51:56.606 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-12-24T21:51:56.607 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7_7.6.noarch from updates"]]}, "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: reflector.westga.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.umd.edu\n * updates: mirror.jaleco.com\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7_7.6 updates 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7_7.6 updates 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n--------------------------------------------------------------------------------\nTotal 2019-12-24T21:51:56.609 INFO:teuthology.task.ansible.out: 20 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n Verifying : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7_7.6 \n\nComplete!\n"]} 2019-12-24T21:51:56.649 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:56 +0000 (0:00:24.397) 0:03:05.538 ****** 2019-12-24T21:51:57.525 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-12-24T21:51:57.527 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-12-24T21:51:57.561 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:57 +0000 (0:00:00.911) 0:03:06.449 ****** 2019-12-24T21:51:59.434 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7_7.6.noarch from updates"]]}, "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: reflector.westga.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.umd.edu\n * updates: mirror.jaleco.com\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7_7.6 updates 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7_7.6 updates 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n---------------------------------------------- 2019-12-24T21:51:59.435 INFO:teuthology.task.ansible.out:----------------------------------\nTotal 27 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n Verifying : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7_7.6 \n\nComplete!\n"]} 2019-12-24T21:51:59.469 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:51:59 +0000 (0:00:01.908) 0:03:08.358 ****** 2019-12-24T21:51:59.978 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-12-24T21:51:59.979 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-12-24T21:52:00.022 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:00 +0000 (0:00:00.549) 0:03:08.907 ****** 2019-12-24T21:52:01.091 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-12-24T21:52:01.092 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7_7.6.noarch from updates"]]}, "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: reflector.westga.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.umd.edu\n * updates: mirror.jaleco.com\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7_7.6 updates 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7_7.6 updates 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n--------------------------------------------------------------------------------\nTotal 2019-12-24T21:52:01.094 INFO:teuthology.task.ansible.out: 29 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n Verifying : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7_7.6 \n\nComplete!\n"]} 2019-12-24T21:52:01.132 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:01 +0000 (0:00:01.113) 0:03:10.021 ****** 2019-12-24T21:52:01.716 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-12-24T21:52:01.717 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-12-24T21:52:01.777 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:01 +0000 (0:00:00.645) 0:03:10.666 ****** 2019-12-24T21:52:05.735 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-12-24T21:52:05.736 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:07.825247", "end": "2019-12-24 21:52:05.698148", "failed_when_result": false, "rc": 0, "start": "2019-12-24 21:51:57.872901", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-12-24T21:52:05.772 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:05 +0000 (0:00:03.994) 0:03:14.661 ****** 2019-12-24T21:52:06.735 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-12-24T21:52:06.788 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:06 +0000 (0:00:01.015) 0:03:15.676 ****** 2019-12-24T21:52:07.138 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-12-24T21:52:07.140 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.023010", "end": "2019-12-24 21:52:07.110291", "rc": 0, "start": "2019-12-24 21:52:07.087281", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-12-24T21:52:07.194 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:07 +0000 (0:00:00.405) 0:03:16.082 ****** 2019-12-24T21:52:07.534 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-12-24T21:52:07.536 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.014522", "end": "2019-12-24 21:52:07.504618", "rc": 0, "start": "2019-12-24 21:52:07.490096", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:52:07.573 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:07 +0000 (0:00:00.379) 0:03:16.462 ****** 2019-12-24T21:52:08.861 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:08.514287", "end": "2019-12-24 21:52:08.826369", "failed_when_result": false, "rc": 0, "start": "2019-12-24 21:52:00.312082", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-12-24T21:52:08.919 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:08 +0000 (0:00:01.345) 0:03:17.807 ****** 2019-12-24T21:52:09.868 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-12-24T21:52:09.870 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-12-24T21:52:09.912 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:09 +0000 (0:00:00.992) 0:03:18.800 ****** 2019-12-24T21:52:10.254 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-12-24T21:52:10.255 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.022311", "end": "2019-12-24 21:52:10.224147", "rc": 0, "start": "2019-12-24 21:52:10.201836", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-12-24T21:52:10.308 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:10 +0000 (0:00:00.395) 0:03:19.196 ****** 2019-12-24T21:52:10.629 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-12-24T21:52:10.630 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.009852", "end": "2019-12-24 21:52:10.607063", "rc": 0, "start": "2019-12-24 21:52:10.597211", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:52:10.683 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:10 +0000 (0:00:00.373) 0:03:19.570 ****** 2019-12-24T21:52:10.787 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:08.674397", "end": "2019-12-24 21:52:10.745404", "failed_when_result": false, "rc": 0, "start": "2019-12-24 21:52:02.071007", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-12-24T21:52:10.856 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:10 +0000 (0:00:00.174) 0:03:19.744 ****** 2019-12-24T21:52:11.869 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-12-24T21:52:11.870 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-12-24T21:52:11.911 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:11 +0000 (0:00:01.055) 0:03:20.800 ****** 2019-12-24T21:52:12.268 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-12-24T21:52:12.270 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.015634", "end": "2019-12-24 21:52:12.234749", "rc": 0, "start": "2019-12-24 21:52:12.219115", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-12-24T21:52:12.333 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:12 +0000 (0:00:00.422) 0:03:21.222 ****** 2019-12-24T21:52:12.688 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-12-24T21:52:12.690 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.021942", "end": "2019-12-24 21:52:12.662950", "rc": 0, "start": "2019-12-24 21:52:12.641008", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:52:12.725 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:12 +0000 (0:00:00.392) 0:03:21.614 ****** 2019-12-24T21:52:15.888 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-12-24T21:52:15.890 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.979278", "end": "2019-12-24 21:52:15.858485", "rc": 0, "start": "2019-12-24 21:52:07.879207", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:52:15.932 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:15 +0000 (0:00:03.206) 0:03:24.820 ****** 2019-12-24T21:52:16.278 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-12-24T21:52:16.280 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-12-24T21:52:16.320 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:16 +0000 (0:00:00.387) 0:03:25.208 ****** 2019-12-24T21:52:16.359 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-12-24T21:52:16.360 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-12-24T21:52:16.400 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:16 +0000 (0:00:00.080) 0:03:25.288 ****** 2019-12-24T21:52:16.442 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-12-24T21:52:16.444 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-24T21:52:16.485 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:16 +0000 (0:00:00.084) 0:03:25.373 ****** 2019-12-24T21:52:16.537 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-12-24T21:52:16.538 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "podman-docker", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN", "python3"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-12-24T21:52:16.583 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:16 +0000 (0:00:00.098) 0:03:25.471 ****** 2019-12-24T21:52:16.622 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-12-24T21:52:16.624 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-24T21:52:16.665 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:16 +0000 (0:00:00.082) 0:03:25.553 ****** 2019-12-24T21:52:17.009 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-12-24T21:52:17.011 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-24T21:52:17.057 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:17 +0000 (0:00:00.392) 0:03:25.946 ****** 2019-12-24T21:52:17.384 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-12-24T21:52:17.386 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-12-24T21:52:17.422 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:17 +0000 (0:00:00.364) 0:03:26.310 ****** 2019-12-24T21:52:17.451 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:52:17.495 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:17 +0000 (0:00:00.073) 0:03:26.383 ****** 2019-12-24T21:52:17.532 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-12-24T21:52:17.534 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:52:17.575 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:17 +0000 (0:00:00.079) 0:03:26.463 ****** 2019-12-24T21:52:17.942 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-12-24T21:52:17.944 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-12-24T21:52:17.978 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:17 +0000 (0:00:00.403) 0:03:26.866 ****** 2019-12-24T21:52:19.023 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-12-24T21:52:19.024 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-12-24T21:52:19.067 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:19 +0000 (0:00:01.089) 0:03:27.955 ****** 2019-12-24T21:52:19.107 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-12-24T21:52:19.109 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi124"}, "changed": false} 2019-12-24T21:52:19.144 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:19 +0000 (0:00:00.077) 0:03:28.033 ****** 2019-12-24T21:52:19.495 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-12-24T21:52:19.496 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:08.478464", "end": "2019-12-24 21:52:19.461332", "rc": 0, "start": "2019-12-24 21:52:10.982868", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:52:19.533 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:19 +0000 (0:00:00.388) 0:03:28.421 ****** 2019-12-24T21:52:19.884 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-12-24T21:52:19.885 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-12-24T21:52:19.924 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:19 +0000 (0:00:00.391) 0:03:28.813 ****** 2019-12-24T21:52:19.963 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-12-24T21:52:19.964 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-12-24T21:52:20.002 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:19 +0000 (0:00:00.077) 0:03:28.890 ****** 2019-12-24T21:52:20.044 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-12-24T21:52:20.046 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-24T21:52:20.093 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:20 +0000 (0:00:00.090) 0:03:28.982 ****** 2019-12-24T21:52:20.131 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-12-24T21:52:20.132 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi124.front.sepia.ceph.com", "ansible_hostname": "smithi124", "ansible_nodename": "smithi124"}, "changed": true, "name": "smithi124"} 2019-12-24T21:52:20.173 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:20 +0000 (0:00:00.079) 0:03:29.061 ****** 2019-12-24T21:52:20.179 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-12-24T21:52:20.180 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "podman-docker", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN", "python3"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-12-24T21:52:20.234 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:20 +0000 (0:00:00.061) 0:03:29.122 ****** 2019-12-24T21:52:20.287 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-12-24T21:52:20.288 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-24T21:52:20.336 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:20 +0000 (0:00:00.101) 0:03:29.224 ****** 2019-12-24T21:52:20.657 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-12-24T21:52:20.658 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-24T21:52:20.732 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:20 +0000 (0:00:00.395) 0:03:29.620 ****** 2019-12-24T21:52:21.035 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-12-24T21:52:21.036 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-12-24T21:52:21.088 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:21 +0000 (0:00:00.355) 0:03:29.976 ****** 2019-12-24T21:52:21.094 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-12-24T21:52:21.095 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-12-24T21:52:21.142 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:21 +0000 (0:00:00.054) 0:03:30.030 ****** 2019-12-24T21:52:21.168 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-12-24T21:52:21.170 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:52:21.218 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:21 +0000 (0:00:00.076) 0:03:30.106 ****** 2019-12-24T21:52:21.262 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:52:21.302 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:21 +0000 (0:00:00.084) 0:03:30.191 ****** 2019-12-24T21:52:21.660 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-12-24T21:52:21.661 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-12-24T21:52:21.713 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:21 +0000 (0:00:00.410) 0:03:30.602 ****** 2019-12-24T21:52:21.721 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-12-24T21:52:21.722 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:08.589221", "end": "2019-12-24 21:52:21.635438", "rc": 0, "start": "2019-12-24 21:52:13.046217", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:52:21.775 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:21 +0000 (0:00:00.060) 0:03:30.662 ****** 2019-12-24T21:52:21.966 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-12-24T21:52:21.967 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-12-24T21:52:22.008 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:22 +0000 (0:00:00.234) 0:03:30.897 ****** 2019-12-24T21:52:22.147 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-12-24T21:52:22.183 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:22 +0000 (0:00:00.174) 0:03:31.072 ****** 2019-12-24T21:52:22.222 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-12-24T21:52:22.223 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-12-24T21:52:22.259 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:22 +0000 (0:00:00.075) 0:03:31.147 ****** 2019-12-24T21:52:22.297 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-12-24T21:52:22.298 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-24T21:52:22.336 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:22 +0000 (0:00:00.075) 0:03:31.223 ****** 2019-12-24T21:52:22.383 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-12-24T21:52:22.384 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "podman-docker", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN", "python3"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-12-24T21:52:22.422 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:22 +0000 (0:00:00.087) 0:03:31.310 ****** 2019-12-24T21:52:22.470 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-12-24T21:52:22.472 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-24T21:52:22.507 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:22 +0000 (0:00:00.085) 0:03:31.396 ****** 2019-12-24T21:52:22.799 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-12-24T21:52:22.801 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-12-24T21:52:22.836 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:22 +0000 (0:00:00.329) 0:03:31.725 ****** 2019-12-24T21:52:22.853 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-12-24T21:52:22.855 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-24T21:52:22.890 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:22 +0000 (0:00:00.053) 0:03:31.779 ****** 2019-12-24T21:52:22.896 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-12-24T21:52:22.898 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi037"}, "changed": false} 2019-12-24T21:52:22.942 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:22 +0000 (0:00:00.050) 0:03:31.829 ****** 2019-12-24T21:52:22.947 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-12-24T21:52:22.948 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-12-24T21:52:22.987 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:22 +0000 (0:00:00.044) 0:03:31.874 ****** 2019-12-24T21:52:23.233 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-12-24T21:52:23.272 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:23 +0000 (0:00:00.285) 0:03:32.160 ****** 2019-12-24T21:52:23.299 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-12-24T21:52:23.300 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:52:23.340 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:23 +0000 (0:00:00.068) 0:03:32.228 ****** 2019-12-24T21:52:23.367 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-12-24T21:52:23.369 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:52:23.405 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:23 +0000 (0:00:00.064) 0:03:32.293 ****** 2019-12-24T21:52:23.487 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-12-24T21:52:23.488 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi037.front.sepia.ceph.com", "ansible_hostname": "smithi037", "ansible_nodename": "smithi037"}, "changed": true, "name": "smithi037"} 2019-12-24T21:52:23.532 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:23 +0000 (0:00:00.127) 0:03:32.420 ****** 2019-12-24T21:52:23.771 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-12-24T21:52:23.773 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-12-24T21:52:23.818 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:23 +0000 (0:00:00.285) 0:03:32.706 ****** 2019-12-24T21:52:23.887 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-12-24T21:52:23.888 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-12-24T21:52:23.930 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:23 +0000 (0:00:00.112) 0:03:32.819 ****** 2019-12-24T21:52:24.241 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-24T21:52:24.241 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-24T21:52:24.281 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:24 +0000 (0:00:00.351) 0:03:33.170 ****** 2019-12-24T21:52:24.485 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-12-24T21:52:24.487 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-12-24T21:52:24.530 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:24 +0000 (0:00:00.248) 0:03:33.418 ****** 2019-12-24T21:52:24.615 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-24T21:52:24.616 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-12-24T21:52:24.681 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:24 +0000 (0:00:00.149) 0:03:33.568 ****** 2019-12-24T21:52:24.843 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-12-24T21:52:24.844 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-12-24T21:52:24.885 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:24 +0000 (0:00:00.205) 0:03:33.773 ****** 2019-12-24T21:52:24.923 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-12-24T21:52:24.925 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi006"}, "changed": false} 2019-12-24T21:52:24.961 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:24 +0000 (0:00:00.075) 0:03:33.849 ****** 2019-12-24T21:52:25.042 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-24T21:52:25.043 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-12-24T21:52:25.081 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:25 +0000 (0:00:00.120) 0:03:33.970 ****** 2019-12-24T21:52:25.476 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-12-24T21:52:25.477 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-12-24T21:52:25.533 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:25 +0000 (0:00:00.451) 0:03:34.422 ****** 2019-12-24T21:52:25.544 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi006.front.sepia.ceph.com", "ansible_hostname": "smithi006", "ansible_nodename": "smithi006"}, "changed": true, "name": "smithi006"} 2019-12-24T21:52:25.580 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:25 +0000 (0:00:00.047) 0:03:34.469 ****** 2019-12-24T21:52:26.052 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-24T21:52:26.053 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-12-24T21:52:26.113 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:26 +0000 (0:00:00.533) 0:03:35.002 ****** 2019-12-24T21:52:26.445 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-12-24T21:52:26.447 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-12-24T21:52:26.483 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:26 +0000 (0:00:00.369) 0:03:35.371 ****** 2019-12-24T21:52:26.542 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-12-24T21:52:26.543 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-12-24T21:52:26.594 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:26 +0000 (0:00:00.111) 0:03:35.482 ****** 2019-12-24T21:52:27.044 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-12-24T21:52:27.084 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:27 +0000 (0:00:00.490) 0:03:35.973 ****** 2019-12-24T21:52:27.428 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-12-24T21:52:27.429 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-12-24T21:52:27.474 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:27 +0000 (0:00:00.388) 0:03:36.362 ****** 2019-12-24T21:52:27.533 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-12-24T21:52:27.535 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-12-24T21:52:27.579 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:27 +0000 (0:00:00.105) 0:03:36.467 ****** 2019-12-24T21:52:27.826 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-24T21:52:27.826 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-24T21:52:27.867 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:27 +0000 (0:00:00.287) 0:03:36.755 ****** 2019-12-24T21:52:28.198 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-12-24T21:52:28.236 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:28 +0000 (0:00:00.369) 0:03:37.124 ****** 2019-12-24T21:52:28.416 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-12-24T21:52:28.417 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-12-24T21:52:28.454 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:28 +0000 (0:00:00.217) 0:03:37.342 ****** 2019-12-24T21:52:28.607 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-24T21:52:28.608 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-12-24T21:52:28.656 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:28 +0000 (0:00:00.202) 0:03:37.544 ****** 2019-12-24T21:52:29.317 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-12-24T21:52:29.318 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-12-24T21:52:29.356 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:29 +0000 (0:00:00.700) 0:03:38.244 ****** 2019-12-24T21:52:29.557 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-24T21:52:29.558 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2019-12-24T21:52:29.558 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.168618", "end": "2019-12-24 21:52:29.517474", "rc": 0, "start": "2019-12-24 21:52:27.348856", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:52:29.608 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:29 +0000 (0:00:00.251) 0:03:38.496 ****** 2019-12-24T21:52:29.637 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-12-24T21:52:29.676 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:29 +0000 (0:00:00.068) 0:03:38.564 ****** 2019-12-24T21:52:29.682 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-24T21:52:29.683 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-12-24T21:52:29.729 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:29 +0000 (0:00:00.053) 0:03:38.618 ****** 2019-12-24T21:52:29.736 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-24T21:52:29.737 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-24T21:52:29.778 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:29 +0000 (0:00:00.048) 0:03:38.667 ****** 2019-12-24T21:52:30.112 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-24T21:52:30.113 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-12-24T21:52:30.163 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:30 +0000 (0:00:00.384) 0:03:39.051 ****** 2019-12-24T21:52:30.575 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* ok: [smithi006.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-12-24T21:52:30.616 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:30 +0000 (0:00:00.453) 0:03:39.505 ****** 2019-12-24T21:52:30.622 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-24T21:52:30.624 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-12-24T21:52:30.711 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-24T21:52:30.712 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-12-24T21:52:30.757 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:30 +0000 (0:00:00.140) 0:03:39.646 ****** 2019-12-24T21:52:31.545 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-24T21:52:31.546 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-12-24T21:52:31.587 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:31 +0000 (0:00:00.830) 0:03:40.476 ****** 2019-12-24T21:52:31.593 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-24T21:52:31.594 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-12-24T21:52:31.634 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:31 +0000 (0:00:00.046) 0:03:40.522 ****** 2019-12-24T21:52:31.640 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2019-12-24T21:52:31.679 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:31 +0000 (0:00:00.044) 0:03:40.567 ****** 2019-12-24T21:52:31.715 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-12-24T21:52:31.717 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:52:31.752 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:31 +0000 (0:00:00.073) 0:03:40.640 ****** 2019-12-24T21:52:31.801 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-12-24T21:52:31.803 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-24T21:52:31.814 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-24T21:52:31.864 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:31 +0000 (0:00:00.112) 0:03:40.752 ****** 2019-12-24T21:52:31.902 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:52:31.941 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:31 +0000 (0:00:00.077) 0:03:40.830 ****** 2019-12-24T21:52:31.978 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-24T21:52:31.980 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-12-24T21:52:32.015 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:32 +0000 (0:00:00.073) 0:03:40.903 ****** 2019-12-24T21:52:32.506 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-12-24T21:52:32.508 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-12-24T21:52:32.543 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:32 +0000 (0:00:00.528) 0:03:41.432 ****** 2019-12-24T21:52:32.666 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-24T21:52:32.667 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-12-24T21:52:32.706 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:32 +0000 (0:00:00.163) 0:03:41.595 ****** 2019-12-24T21:52:33.177 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-12-24T21:52:33.178 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.290928", "end": "2019-12-24 21:52:33.142040", "rc": 0, "start": "2019-12-24 21:52:32.851112", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: reflector.westga.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.umd.edu\n * updates: mirror.jaleco.com\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: reflector.westga.edu", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirror.umd.edu", " * updates: mirror.jaleco.com", "No unfinished transactions left."]} 2019-12-24T21:52:33.217 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:33 +0000 (0:00:00.510) 0:03:42.105 ****** 2019-12-24T21:52:33.243 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-24T21:52:33.245 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.162601", "end": "2019-12-24 21:52:33.214990", "rc": 0, "start": "2019-12-24 21:52:31.052389", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:52:33.283 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:33 +0000 (0:00:00.066) 0:03:42.172 ****** 2019-12-24T21:52:33.311 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-12-24T21:52:33.348 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:33 +0000 (0:00:00.064) 0:03:42.236 ****** 2019-12-24T21:52:33.604 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-12-24T21:52:33.605 INFO:teuthology.task.ansible.out:fatal: [smithi124.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.050350", "end": "2019-12-24 21:52:33.568949", "msg": "non-zero return code", "rc": 1, "start": "2019-12-24 21:52:33.518599", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} 2019-12-24T21:52:33.605 INFO:teuthology.task.ansible.out:...ignoring 2019-12-24T21:52:33.647 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:33 +0000 (0:00:00.298) 0:03:42.535 ****** 2019-12-24T21:52:33.685 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-12-24T21:52:33.687 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:52:33.722 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:33 +0000 (0:00:00.075) 0:03:42.610 ****** 2019-12-24T21:52:34.302 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-24T21:52:34.303 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-12-24T21:52:35.222 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-12-24T21:52:35.266 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:35 +0000 (0:00:01.544) 0:03:44.155 ****** 2019-12-24T21:52:35.295 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2019-12-24T21:52:35.336 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:35 +0000 (0:00:00.069) 0:03:44.224 ****** 2019-12-24T21:52:35.343 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-24T21:52:35.345 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.282640", "end": "2019-12-24 21:52:35.296732", "rc": 0, "start": "2019-12-24 21:52:33.014092", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:52:35.399 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:35 +0000 (0:00:00.062) 0:03:44.287 ****** 2019-12-24T21:52:35.404 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-12-24T21:52:35.405 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:52:35.444 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:35 +0000 (0:00:00.045) 0:03:44.333 ****** 2019-12-24T21:52:35.451 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-12-24T21:52:35.500 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:35 +0000 (0:00:00.055) 0:03:44.388 ****** 2019-12-24T21:52:35.506 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-12-24T21:52:35.506 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-24T21:52:35.508 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-24T21:52:35.548 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:35 +0000 (0:00:00.047) 0:03:44.436 ****** 2019-12-24T21:52:35.575 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-12-24T21:52:35.576 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:52:35.612 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:35 +0000 (0:00:00.064) 0:03:44.501 ****** 2019-12-24T21:52:35.652 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-12-24T21:52:35.688 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:35 +0000 (0:00:00.074) 0:03:44.575 ****** 2019-12-24T21:52:36.198 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-12-24T21:52:36.200 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-12-24T21:52:36.237 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:36 +0000 (0:00:00.549) 0:03:45.126 ****** 2019-12-24T21:52:36.507 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-24T21:52:36.508 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-12-24T21:52:36.908 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-12-24T21:52:36.910 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.328575", "end": "2019-12-24 21:52:36.874915", "rc": 0, "start": "2019-12-24 21:52:36.546340", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: reflector.westga.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.umd.edu\n * updates: mirror.jaleco.com\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: reflector.westga.edu", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirror.umd.edu", " * updates: mirror.jaleco.com", "No unfinished transactions left."]} 2019-12-24T21:52:36.954 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:36 +0000 (0:00:00.716) 0:03:45.842 ****** 2019-12-24T21:52:37.346 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-12-24T21:52:37.347 INFO:teuthology.task.ansible.out:fatal: [smithi037.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.057440", "end": "2019-12-24 21:52:37.313201", "msg": "non-zero return code", "rc": 1, "start": "2019-12-24 21:52:37.255761", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} 2019-12-24T21:52:37.347 INFO:teuthology.task.ansible.out:...ignoring 2019-12-24T21:52:37.394 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:37 +0000 (0:00:00.439) 0:03:46.282 ****** 2019-12-24T21:52:37.435 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-12-24T21:52:37.437 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:52:37.475 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:37 +0000 (0:00:00.080) 0:03:46.363 ****** 2019-12-24T21:52:37.482 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-24T21:52:37.483 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-12-24T21:52:37.533 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:37 +0000 (0:00:00.057) 0:03:46.421 ****** 2019-12-24T21:52:37.560 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2019-12-24T21:52:37.596 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:37 +0000 (0:00:00.063) 0:03:46.485 ****** 2019-12-24T21:52:37.624 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-12-24T21:52:37.625 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:52:37.664 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:37 +0000 (0:00:00.067) 0:03:46.552 ****** 2019-12-24T21:52:37.701 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-12-24T21:52:37.703 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-24T21:52:37.713 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-24T21:52:37.766 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:37 +0000 (0:00:00.101) 0:03:46.654 ****** 2019-12-24T21:52:37.803 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-12-24T21:52:37.805 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:52:37.840 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:37 +0000 (0:00:00.074) 0:03:46.729 ****** 2019-12-24T21:52:37.878 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-24T21:52:37.879 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-12-24T21:52:37.915 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:37 +0000 (0:00:00.074) 0:03:46.803 ****** 2019-12-24T21:52:38.428 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-12-24T21:52:38.430 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-12-24T21:52:38.468 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:38 +0000 (0:00:00.553) 0:03:47.357 ****** 2019-12-24T21:52:39.120 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-12-24T21:52:39.122 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.333189", "end": "2019-12-24 21:52:39.087200", "rc": 0, "start": "2019-12-24 21:52:38.754011", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: reflector.westga.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.umd.edu\n * updates: mirror.jaleco.com\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: reflector.westga.edu", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirror.umd.edu", " * updates: mirror.jaleco.com", "No unfinished transactions left."]} 2019-12-24T21:52:39.158 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:39 +0000 (0:00:00.689) 0:03:48.046 ****** 2019-12-24T21:52:39.546 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-12-24T21:52:39.547 INFO:teuthology.task.ansible.out:fatal: [smithi006.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.058484", "end": "2019-12-24 21:52:39.520261", "msg": "non-zero return code", "rc": 1, "start": "2019-12-24 21:52:39.461777", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-12-24T21:52:39.598 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:39 +0000 (0:00:00.440) 0:03:48.487 ****** 2019-12-24T21:52:39.640 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-12-24T21:52:39.642 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:52:39.679 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:39 +0000 (0:00:00.080) 0:03:48.567 ****** 2019-12-24T21:52:42.312 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-24T21:52:42.313 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-12-24T21:52:42.315 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-12-24T21:52:42.316 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-24T21:52:42.353 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:42 +0000 (0:00:02.674) 0:03:51.242 ****** 2019-12-24T21:52:45.741 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-12-24T21:52:45.742 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-12-24T21:52:45.744 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-24T21:52:45.792 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:45 +0000 (0:00:03.436) 0:03:54.679 ****** 2019-12-24T21:52:45.799 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-24T21:52:45.801 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-12-24T21:52:45.803 INFO:teuthology.task.ansible.out: 2019-12-24T21:52:45.843 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:45 +0000 (0:00:00.052) 0:03:54.731 ****** 2019-12-24T21:52:48.046 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 2019-12-24T21:52:48.048 INFO:teuthology.task.ansible.out: @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemov 2019-12-24T21:52:48.049 INFO:teuthology.task.ansible.out:ed:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-24T21:52:48.090 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:48 +0000 (0:00:02.247) 0:03:56.979 ****** 2019-12-24T21:52:49.177 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-24T21:52:49.178 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-12-24T21:52:49.221 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:49 +0000 (0:00:01.131) 0:03:58.110 ****** 2019-12-24T21:52:51.538 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-12-24T21:52:51.604 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:52:51 +0000 (0:00:02.382) 0:04:00.492 ****** 2019-12-24T21:53:10.812 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-24T21:53:10.814 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "podman-docker", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "python3"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 pr 2019-12-24T21:53:10.820 INFO:teuthology.task.ansible.out:oviding btrfs-progs is already installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-op 2019-12-24T21:53:10.822 INFO:teuthology.task.ansible.out:enjdk-devel is already installed", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: reflector.westga.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.umd.edu\n * updates: mirror.jaleco.com\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package podman-docker.noarch 0:1.4.4-4.el7.centos will be installed\n---> Package python3.x86_64 0:3.6.8-10.el7 will be installed\n--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64\n--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64\n--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64\n--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Pack 2019-12-24T21:53:10.824 INFO:teuthology.task.ansible.out:age librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed\n---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed\n---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n podman-docker noarch 1.4.4-4.el7.centos extras 26 k\n python3 x86_64 3.6.8-10.el7 base 69 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n python3-libs x86_64 3.6.8-10.el7 base 7.0 M\n python3-pip noarch 9.0.3-5.el7 base 1.8 M\n python3-setuptools noarch 39.2.0-10.el7 base 629 k\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\ 2019-12-24T21:53:10.826 INFO:teuthology.task.ansible.out:n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 5 Packages (+8 Dependent packages)\n\nTotal download size: 18 M\nInstalled size: 70 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 24 MB/s | 18 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/13 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/13 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/13 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/13 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/13 \n Installing : python3-libs-3.6.8-10.el7.x86_64 6/13 \n Installing : python3-setuptools-39.2.0-10.el7.noarch 7/13 \n Installing : python3-3.6.8-10.el7.x86_64 8/13 \n Installing : python3-pip-9.0.3-5.el7.noarch 9/13 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 10/13 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 11/13 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 12/13 \n Installing : podman-docker-1.4.4-4.el7.centos.noarch 13/13 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/13 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/13 \n Verifying : python3-pip-9.0.3-5.el7.noarch 3/13 \n Verifying : python3-libs-3.6.8-10.el7.x86_64 4/13 \n Verifying : 1:librados2-10.2.5- 2019-12-24T21:53:10.828 INFO:teuthology.task.ansible.out:4.el7.x86_64 5/13 \n Verifying : podman-docker-1.4.4-4.el7.centos.noarch 6/13 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/13 \n Verifying : python3-setuptools-39.2.0-10.el7.noarch 8/13 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 9/13 \n Verifying : boost-random-1.53.0-27.el7.x86_64 10/13 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 11/13 \n Verifying : python3-3.6.8-10.el7.x86_64 12/13 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 13/13 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n podman-docker.noarch 0:1.4.4-4.el7.centos \n python3.x86_64 0:3.6.8-10.el7 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n python3-libs.x86_64 0:3.6.8-10.el7 \n python3-pip.noarch 0:9.0.3-5.el7 \n python3-setuptools.noarch 0:39.2.0-10.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-24T21:53:10.855 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:10 +0000 (0:00:19.250) 0:04:19.743 ****** 2019-12-24T21:53:11.666 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-12-24T21:53:11.703 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:11 +0000 (0:00:00.848) 0:04:20.592 ****** 2019-12-24T21:53:12.221 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-12-24T21:53:12.268 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:12 +0000 (0:00:00.563) 0:04:21.156 ****** 2019-12-24T21:53:12.302 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-24T21:53:12.304 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:12.339 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:12 +0000 (0:00:00.071) 0:04:21.227 ****** 2019-12-24T21:53:12.754 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-12-24T21:53:12.756 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service basic.target system.slice dbus.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ebtables.service ip6tables.service ipset.service iptables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-12-24T21:53:12.758 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-12-24T21:53:12.759 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-24T21:53:12.800 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:12 +0000 (0:00:00.461) 0:04:21.688 ****** 2019-12-24T21:53:13.199 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-12-24T21:53:13.200 INFO:teuthology.task.ansible.out:fatal: [smithi124.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-12-24T21:53:13.239 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:13 +0000 (0:00:00.435) 0:04:22.124 ****** 2019-12-24T21:53:14.112 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-12-24T21:53:14.146 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:14 +0000 (0:00:00.911) 0:04:23.035 ****** 2019-12-24T21:53:14.173 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-12-24T21:53:14.176 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:14.210 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:14 +0000 (0:00:00.063) 0:04:23.099 ****** 2019-12-24T21:53:14.248 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-12-24T21:53:14.286 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:14 +0000 (0:00:00.073) 0:04:23.172 ****** 2019-12-24T21:53:14.334 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-12-24T21:53:14.336 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:14.392 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:14 +0000 (0:00:00.104) 0:04:23.277 ****** 2019-12-24T21:53:14.418 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-12-24T21:53:14.420 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:14.459 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:14 +0000 (0:00:00.069) 0:04:23.347 ****** 2019-12-24T21:53:14.500 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-12-24T21:53:14.501 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:14.502 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:14.544 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:14 +0000 (0:00:00.085) 0:04:23.433 ****** 2019-12-24T21:53:14.571 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-12-24T21:53:14.573 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:14.609 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:14 +0000 (0:00:00.064) 0:04:23.498 ****** 2019-12-24T21:53:14.636 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-12-24T21:53:14.672 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:14 +0000 (0:00:00.063) 0:04:23.561 ****** 2019-12-24T21:53:14.699 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-12-24T21:53:14.700 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:14.737 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:14 +0000 (0:00:00.064) 0:04:23.625 ****** 2019-12-24T21:53:14.769 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-12-24T21:53:14.771 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:14.810 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:14 +0000 (0:00:00.073) 0:04:23.699 ****** 2019-12-24T21:53:14.837 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-12-24T21:53:14.839 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:14.875 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:14 +0000 (0:00:00.064) 0:04:23.764 ****** 2019-12-24T21:53:14.892 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-24T21:53:14.893 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "podman-docker", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "python3"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 pr 2019-12-24T21:53:14.895 INFO:teuthology.task.ansible.out:oviding btrfs-progs is already installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-op 2019-12-24T21:53:14.896 INFO:teuthology.task.ansible.out:enjdk-devel is already installed", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: reflector.westga.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.umd.edu\n * updates: mirror.jaleco.com\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package podman-docker.noarch 0:1.4.4-4.el7.centos will be installed\n---> Package python3.x86_64 0:3.6.8-10.el7 will be installed\n--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64\n--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64\n--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64\n--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Pack 2019-12-24T21:53:14.898 INFO:teuthology.task.ansible.out:age librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed\n---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed\n---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n podman-docker noarch 1.4.4-4.el7.centos extras 26 k\n python3 x86_64 3.6.8-10.el7 base 69 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n python3-libs x86_64 3.6.8-10.el7 base 7.0 M\n python3-pip noarch 9.0.3-5.el7 base 1.8 M\n python3-setuptools noarch 39.2.0-10.el7 base 629 k\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\ 2019-12-24T21:53:14.900 INFO:teuthology.task.ansible.out:n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 5 Packages (+8 Dependent packages)\n\nTotal download size: 18 M\nInstalled size: 70 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 21 MB/s | 18 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/13 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/13 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/13 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/13 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/13 \n Installing : python3-libs-3.6.8-10.el7.x86_64 6/13 \n Installing : python3-setuptools-39.2.0-10.el7.noarch 7/13 \n Installing : python3-3.6.8-10.el7.x86_64 8/13 \n Installing : python3-pip-9.0.3-5.el7.noarch 9/13 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 10/13 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 11/13 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 12/13 \n Installing : podman-docker-1.4.4-4.el7.centos.noarch 13/13 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/13 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/13 \n Verifying : python3-pip-9.0.3-5.el7.noarch 3/13 \n Verifying : python3-libs-3.6.8-10.el7.x86_64 4/13 \n Verifying : 1:librados2-10.2.5- 2019-12-24T21:53:14.901 INFO:teuthology.task.ansible.out:4.el7.x86_64 5/13 \n Verifying : podman-docker-1.4.4-4.el7.centos.noarch 6/13 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/13 \n Verifying : python3-setuptools-39.2.0-10.el7.noarch 8/13 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 9/13 \n Verifying : boost-random-1.53.0-27.el7.x86_64 10/13 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 11/13 \n Verifying : python3-3.6.8-10.el7.x86_64 12/13 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 13/13 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n podman-docker.noarch 0:1.4.4-4.el7.centos \n python3.x86_64 0:3.6.8-10.el7 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n python3-libs.x86_64 0:3.6.8-10.el7 \n python3-pip.noarch 0:9.0.3-5.el7 \n python3-setuptools.noarch 0:39.2.0-10.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-24T21:53:14.931 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:14 +0000 (0:00:00.056) 0:04:23.820 ****** 2019-12-24T21:53:14.944 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:14.977 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:14 +0000 (0:00:00.046) 0:04:23.866 ****** 2019-12-24T21:53:15.004 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:15.046 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:15 +0000 (0:00:00.068) 0:04:23.935 ****** 2019-12-24T21:53:15.078 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:15.114 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:15 +0000 (0:00:00.067) 0:04:24.002 ****** 2019-12-24T21:53:15.141 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-12-24T21:53:15.143 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:15.183 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:15 +0000 (0:00:00.069) 0:04:24.072 ****** 2019-12-24T21:53:15.210 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-12-24T21:53:15.212 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:15.248 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:15 +0000 (0:00:00.064) 0:04:24.137 ****** 2019-12-24T21:53:15.280 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:15.321 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:15 +0000 (0:00:00.072) 0:04:24.210 ****** 2019-12-24T21:53:15.353 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-12-24T21:53:15.355 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:15.390 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:15 +0000 (0:00:00.068) 0:04:24.278 ****** 2019-12-24T21:53:15.421 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-12-24T21:53:15.422 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:15.459 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:15 +0000 (0:00:00.069) 0:04:24.347 ****** 2019-12-24T21:53:15.485 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-12-24T21:53:15.487 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:15.523 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:15 +0000 (0:00:00.063) 0:04:24.411 ****** 2019-12-24T21:53:15.553 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:15.589 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:15 +0000 (0:00:00.063) 0:04:24.475 ****** 2019-12-24T21:53:15.613 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-12-24T21:53:15.615 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:15.651 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:15 +0000 (0:00:00.064) 0:04:24.540 ****** 2019-12-24T21:53:15.680 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-24T21:53:15.681 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:15.719 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:15 +0000 (0:00:00.066) 0:04:24.606 ****** 2019-12-24T21:53:15.743 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-12-24T21:53:15.744 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-12-24T21:53:15.792 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:15 +0000 (0:00:00.070) 0:04:24.677 ****** 2019-12-24T21:53:15.798 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-24T21:53:15.799 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:15.837 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:15 +0000 (0:00:00.047) 0:04:24.725 ****** 2019-12-24T21:53:15.865 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-24T21:53:15.867 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:15.902 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:15 +0000 (0:00:00.065) 0:04:24.790 ****** 2019-12-24T21:53:15.939 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-24T21:53:15.942 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:15.977 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:15 +0000 (0:00:00.074) 0:04:24.865 ****** 2019-12-24T21:53:16.014 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-24T21:53:16.016 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:16.061 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:16 +0000 (0:00:00.080) 0:04:24.946 ****** 2019-12-24T21:53:16.085 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-24T21:53:16.087 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:16.130 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:16 +0000 (0:00:00.072) 0:04:25.018 ****** 2019-12-24T21:53:16.157 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-24T21:53:16.159 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:16.211 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:16 +0000 (0:00:00.080) 0:04:25.099 ****** 2019-12-24T21:53:16.240 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-24T21:53:16.242 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:16.281 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:16 +0000 (0:00:00.069) 0:04:25.169 ****** 2019-12-24T21:53:16.319 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-24T21:53:16.320 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:16.363 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:16 +0000 (0:00:00.082) 0:04:25.252 ****** 2019-12-24T21:53:16.372 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-24T21:53:16.373 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-12-24T21:53:16.413 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:16 +0000 (0:00:00.049) 0:04:25.302 ****** 2019-12-24T21:53:16.419 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-24T21:53:16.421 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:16.458 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:16 +0000 (0:00:00.044) 0:04:25.346 ****** 2019-12-24T21:53:16.464 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-24T21:53:16.467 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:16.504 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:16 +0000 (0:00:00.045) 0:04:25.392 ****** 2019-12-24T21:53:16.511 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-24T21:53:16.511 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:16.549 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:16 +0000 (0:00:00.045) 0:04:25.438 ****** 2019-12-24T21:53:16.577 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-24T21:53:16.578 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:16.620 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:16 +0000 (0:00:00.070) 0:04:25.508 ****** 2019-12-24T21:53:16.850 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-24T21:53:16.852 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "podman-docker", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "python3"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 pr 2019-12-24T21:53:16.854 INFO:teuthology.task.ansible.out:oviding btrfs-progs is already installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-op 2019-12-24T21:53:16.855 INFO:teuthology.task.ansible.out:enjdk-devel is already installed", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: reflector.westga.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.umd.edu\n * updates: mirror.jaleco.com\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package podman-docker.noarch 0:1.4.4-4.el7.centos will be installed\n---> Package python3.x86_64 0:3.6.8-10.el7 will be installed\n--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64\n--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64\n--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64\n--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Pack 2019-12-24T21:53:16.857 INFO:teuthology.task.ansible.out:age librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed\n---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed\n---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n podman-docker noarch 1.4.4-4.el7.centos extras 26 k\n python3 x86_64 3.6.8-10.el7 base 69 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n python3-libs x86_64 3.6.8-10.el7 base 7.0 M\n python3-pip noarch 9.0.3-5.el7 base 1.8 M\n python3-setuptools noarch 39.2.0-10.el7 base 629 k\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\ 2019-12-24T21:53:16.858 INFO:teuthology.task.ansible.out:n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 5 Packages (+8 Dependent packages)\n\nTotal download size: 18 M\nInstalled size: 70 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 30 MB/s | 18 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/13 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/13 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/13 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/13 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/13 \n Installing : python3-libs-3.6.8-10.el7.x86_64 6/13 \n Installing : python3-setuptools-39.2.0-10.el7.noarch 7/13 \n Installing : python3-3.6.8-10.el7.x86_64 8/13 \n Installing : python3-pip-9.0.3-5.el7.noarch 9/13 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 10/13 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 11/13 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 12/13 \n Installing : podman-docker-1.4.4-4.el7.centos.noarch 13/13 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/13 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/13 \n Verifying : python3-pip-9.0.3-5.el7.noarch 3/13 \n Verifying : python3-libs-3.6.8-10.el7.x86_64 4/13 \n Verifying : 1:librados2-10.2.5- 2019-12-24T21:53:16.860 INFO:teuthology.task.ansible.out:4.el7.x86_64 5/13 \n Verifying : podman-docker-1.4.4-4.el7.centos.noarch 6/13 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/13 \n Verifying : python3-setuptools-39.2.0-10.el7.noarch 8/13 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 9/13 \n Verifying : boost-random-1.53.0-27.el7.x86_64 10/13 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 11/13 \n Verifying : python3-3.6.8-10.el7.x86_64 12/13 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 13/13 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n podman-docker.noarch 0:1.4.4-4.el7.centos \n python3.x86_64 0:3.6.8-10.el7 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n python3-libs.x86_64 0:3.6.8-10.el7 \n python3-pip.noarch 0:9.0.3-5.el7 \n python3-setuptools.noarch 0:39.2.0-10.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-24T21:53:16.903 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:16 +0000 (0:00:00.283) 0:04:25.791 ****** 2019-12-24T21:53:16.942 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-24T21:53:16.943 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-12-24T21:53:16.944 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-12-24T21:53:16.946 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice polkit.service dbus.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "shutdown.target ipset.service ebtables.service ip6tables.service iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-12-24T21:53:16.947 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-12-24T21:53:16.949 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-24T21:53:16.995 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:16 +0000 (0:00:00.089) 0:04:25.881 ****** 2019-12-24T21:53:17.031 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:17 +0000 (0:00:00.037) 0:04:25.919 ****** 2019-12-24T21:53:17.387 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-24T21:53:17.389 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-24T21:53:17.437 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:17 +0000 (0:00:00.406) 0:04:26.325 ****** 2019-12-24T21:53:17.443 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-12-24T21:53:17.443 INFO:teuthology.task.ansible.out:fatal: [smithi037.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-12-24T21:53:17.483 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:17 +0000 (0:00:00.045) 0:04:26.371 ****** 2019-12-24T21:53:17.713 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-12-24T21:53:17.714 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-12-24T21:53:17.764 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:17 +0000 (0:00:00.281) 0:04:26.653 ****** 2019-12-24T21:53:17.772 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-24T21:53:17.773 INFO:teuthology.task.ansible.out: [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. 2019-12-24T21:53:17.775 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-12-24T21:53:17.819 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:17 +0000 (0:00:00.055) 0:04:26.708 ****** 2019-12-24T21:53:17.858 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:17.898 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:17 +0000 (0:00:00.078) 0:04:26.787 ****** 2019-12-24T21:53:17.904 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2019-12-24T21:53:17.904 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-12-24T21:53:17.945 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:17 +0000 (0:00:00.047) 0:04:26.834 ****** 2019-12-24T21:53:17.951 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-24T21:53:17.952 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:17.994 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:17 +0000 (0:00:00.048) 0:04:26.882 ****** 2019-12-24T21:53:18.000 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-12-24T21:53:18.002 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:18.041 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:18 +0000 (0:00:00.047) 0:04:26.930 ****** 2019-12-24T21:53:18.048 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-24T21:53:18.048 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:18.087 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:18 +0000 (0:00:00.045) 0:04:26.975 ****** 2019-12-24T21:53:18.096 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-12-24T21:53:18.140 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:18 +0000 (0:00:00.049) 0:04:27.025 ****** 2019-12-24T21:53:18.144 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-24T21:53:18.146 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:18.202 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:18 +0000 (0:00:00.064) 0:04:27.090 ****** 2019-12-24T21:53:18.211 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-12-24T21:53:18.213 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:18.251 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:18 +0000 (0:00:00.049) 0:04:27.139 ****** 2019-12-24T21:53:18.260 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-24T21:53:18.261 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:18.303 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:18 +0000 (0:00:00.052) 0:04:27.192 ****** 2019-12-24T21:53:18.309 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-12-24T21:53:18.310 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-12-24T21:53:18.364 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:18 +0000 (0:00:00.060) 0:04:27.252 ****** 2019-12-24T21:53:18.406 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:18 +0000 (0:00:00.042) 0:04:27.294 ****** 2019-12-24T21:53:18.412 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-24T21:53:18.416 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:18.453 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:18 +0000 (0:00:00.047) 0:04:27.341 ****** 2019-12-24T21:53:18.494 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:18 +0000 (0:00:00.041) 0:04:27.383 ****** 2019-12-24T21:53:18.500 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-12-24T21:53:18.501 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:18.503 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:18.545 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:18 +0000 (0:00:00.050) 0:04:27.434 ****** 2019-12-24T21:53:18.556 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:18.590 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:18 +0000 (0:00:00.044) 0:04:27.479 ****** 2019-12-24T21:53:18.596 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-12-24T21:53:18.597 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:18.638 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:18 +0000 (0:00:00.048) 0:04:27.527 ****** 2019-12-24T21:53:18.645 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-24T21:53:18.647 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:18.686 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:18 +0000 (0:00:00.047) 0:04:27.574 ****** 2019-12-24T21:53:18.695 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-12-24T21:53:18.733 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:18 +0000 (0:00:00.045) 0:04:27.620 ****** 2019-12-24T21:53:18.738 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-24T21:53:18.741 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:18.779 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:18 +0000 (0:00:00.047) 0:04:27.668 ****** 2019-12-24T21:53:18.785 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-12-24T21:53:18.786 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:18.826 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:18 +0000 (0:00:00.046) 0:04:27.714 ****** 2019-12-24T21:53:18.833 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-12-24T21:53:18.835 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:18.874 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:18 +0000 (0:00:00.048) 0:04:27.762 ****** 2019-12-24T21:53:18.881 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-12-24T21:53:18.882 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:18.927 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:18 +0000 (0:00:00.050) 0:04:27.813 ****** 2019-12-24T21:53:18.933 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-12-24T21:53:18.935 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable firewalld] *********************************** 2019-12-24T21:53:18.937 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service system.slice basic.target dbus.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ipset.service iptables.service shutdown.target ip6tables.service ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-12-24T21:53:18.938 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-12-24T21:53:18.940 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-24T21:53:18.980 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:18 +0000 (0:00:00.055) 0:04:27.869 ****** 2019-12-24T21:53:19.015 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.034) 0:04:27.903 ****** 2019-12-24T21:53:19.020 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-12-24T21:53:19.021 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:19.065 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.050) 0:04:27.953 ****** 2019-12-24T21:53:19.072 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-24T21:53:19.073 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:19.112 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.047) 0:04:28.001 ****** 2019-12-24T21:53:19.118 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-24T21:53:19.119 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:19.160 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.047) 0:04:28.048 ****** 2019-12-24T21:53:19.166 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-24T21:53:19.168 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:19.205 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.044) 0:04:28.093 ****** 2019-12-24T21:53:19.211 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:19.250 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.045) 0:04:28.138 ****** 2019-12-24T21:53:19.256 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-12-24T21:53:19.257 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:19.294 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.043) 0:04:28.182 ****** 2019-12-24T21:53:19.301 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-24T21:53:19.302 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:19.341 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.046) 0:04:28.229 ****** 2019-12-24T21:53:19.355 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:19.387 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.046) 0:04:28.275 ****** 2019-12-24T21:53:19.395 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:19.435 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.048) 0:04:28.324 ****** 2019-12-24T21:53:19.441 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-12-24T21:53:19.442 INFO:teuthology.task.ansible.out:fatal: [smithi006.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-12-24T21:53:19.443 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:19.488 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.045) 0:04:28.369 ****** 2019-12-24T21:53:19.516 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.035) 0:04:28.405 ****** 2019-12-24T21:53:19.522 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-12-24T21:53:19.523 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:19.563 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.046) 0:04:28.451 ****** 2019-12-24T21:53:19.569 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-12-24T21:53:19.570 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:19.607 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.044) 0:04:28.496 ****** 2019-12-24T21:53:19.613 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-12-24T21:53:19.613 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:19.654 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.046) 0:04:28.542 ****** 2019-12-24T21:53:19.659 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-12-24T21:53:19.660 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:19.697 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.043) 0:04:28.586 ****** 2019-12-24T21:53:19.704 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-12-24T21:53:19.708 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:19.744 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.046) 0:04:28.632 ****** 2019-12-24T21:53:19.750 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-12-24T21:53:19.752 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:19.789 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.045) 0:04:28.677 ****** 2019-12-24T21:53:19.794 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-12-24T21:53:19.795 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:19.841 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.052) 0:04:28.729 ****** 2019-12-24T21:53:19.848 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:19.888 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.046) 0:04:28.776 ****** 2019-12-24T21:53:19.895 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2019-12-24T21:53:19.895 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-12-24T21:53:19.897 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:19.940 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.051) 0:04:28.828 ****** 2019-12-24T21:53:19.984 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:19 +0000 (0:00:00.043) 0:04:28.872 ****** 2019-12-24T21:53:19.990 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-12-24T21:53:19.992 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for custom repos] *************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:20.041 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.057) 0:04:28.930 ****** 2019-12-24T21:53:20.093 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.051) 0:04:28.981 ****** 2019-12-24T21:53:20.100 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove custom repos] ****************************************** 2019-12-24T21:53:20.140 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.046) 0:04:29.028 ****** 2019-12-24T21:53:20.175 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.035) 0:04:29.063 ****** 2019-12-24T21:53:20.181 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-12-24T21:53:20.182 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:20.183 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:20.222 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.047) 0:04:29.110 ****** 2019-12-24T21:53:20.257 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.034) 0:04:29.145 ****** 2019-12-24T21:53:20.263 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-12-24T21:53:20.263 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:20.265 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:20.303 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.046) 0:04:29.192 ****** 2019-12-24T21:53:20.341 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.037) 0:04:29.229 ****** 2019-12-24T21:53:20.348 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-24T21:53:20.350 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} TASK [testnode : Install apt keys] ********************************************* skipping: [smithi006.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:20.391 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.050) 0:04:29.279 ****** 2019-12-24T21:53:20.425 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.034) 0:04:29.313 ****** 2019-12-24T21:53:20.431 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-24T21:53:20.433 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install python-apt] ******************************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:20.474 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.045) 0:04:29.359 ****** 2019-12-24T21:53:20.530 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.059) 0:04:29.419 ****** 2019-12-24T21:53:20.537 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-12-24T21:53:20.537 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:20.539 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi124.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:20.540 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi124.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:20.542 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:20.542 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:20.582 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.052) 0:04:29.471 ****** 2019-12-24T21:53:20.625 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.042) 0:04:29.514 ****** 2019-12-24T21:53:20.631 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-24T21:53:20.633 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:20.672 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.046) 0:04:29.561 ****** 2019-12-24T21:53:20.709 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.036) 0:04:29.597 ****** 2019-12-24T21:53:20.715 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-12-24T21:53:20.716 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:20.757 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.048) 0:04:29.646 ****** 2019-12-24T21:53:20.763 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-24T21:53:20.765 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:20.808 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.050) 0:04:29.696 ****** 2019-12-24T21:53:20.815 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-12-24T21:53:20.816 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004840", "end": "2019-12-24 21:53:20.750637", "rc": 0, "start": "2019-12-24 21:53:20.745797", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-12-24T21:53:20.817 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:20.859 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.046) 0:04:29.743 ****** 2019-12-24T21:53:20.896 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.041) 0:04:29.784 ****** 2019-12-24T21:53:20.902 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-24T21:53:20.902 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:20.904 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:20.943 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.046) 0:04:29.831 ****** 2019-12-24T21:53:20.983 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:20 +0000 (0:00:00.040) 0:04:29.872 ****** 2019-12-24T21:53:20.989 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-12-24T21:53:20.990 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:20.991 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:21.032 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.048) 0:04:29.920 ****** 2019-12-24T21:53:21.074 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.038) 0:04:29.959 ****** 2019-12-24T21:53:21.078 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-24T21:53:21.080 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:21.118 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.047) 0:04:30.006 ****** 2019-12-24T21:53:21.154 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.036) 0:04:30.043 ****** 2019-12-24T21:53:21.160 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-12-24T21:53:21.162 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:21.203 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.048) 0:04:30.092 ****** 2019-12-24T21:53:21.245 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.041) 0:04:30.133 ****** 2019-12-24T21:53:21.255 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-24T21:53:21.257 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:21.303 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.058) 0:04:30.191 ****** 2019-12-24T21:53:21.337 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.033) 0:04:30.225 ****** 2019-12-24T21:53:21.345 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-12-24T21:53:21.347 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:21.393 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.049) 0:04:30.275 ****** 2019-12-24T21:53:21.434 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.047) 0:04:30.322 ****** 2019-12-24T21:53:21.439 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-24T21:53:21.440 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:21.442 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:21.480 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.046) 0:04:30.368 ****** 2019-12-24T21:53:21.520 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.040) 0:04:30.409 ****** 2019-12-24T21:53:21.527 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-12-24T21:53:21.528 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:21.572 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.048) 0:04:30.458 ****** 2019-12-24T21:53:21.606 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.037) 0:04:30.495 ****** 2019-12-24T21:53:21.613 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-24T21:53:21.614 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:21.653 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.046) 0:04:30.542 ****** 2019-12-24T21:53:21.655 INFO:teuthology.task.ansible.out: 2019-12-24T21:53:21.689 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.035) 0:04:30.578 ****** 2019-12-24T21:53:21.696 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-12-24T21:53:21.698 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:21.738 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.048) 0:04:30.626 ****** 2019-12-24T21:53:21.743 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-24T21:53:21.744 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:21.783 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.045) 0:04:30.672 ****** 2019-12-24T21:53:21.789 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-12-24T21:53:21.792 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:21.828 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.045) 0:04:30.717 ****** 2019-12-24T21:53:21.835 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-24T21:53:21.837 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:21.874 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.045) 0:04:30.763 ****** 2019-12-24T21:53:21.880 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-24T21:53:21.880 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:21.919 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.044) 0:04:30.808 ****** 2019-12-24T21:53:21.926 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-24T21:53:21.926 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:21.966 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:21 +0000 (0:00:00.046) 0:04:30.854 ****** 2019-12-24T21:53:21.971 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-24T21:53:21.972 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:22.013 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:22 +0000 (0:00:00.047) 0:04:30.902 ****** 2019-12-24T21:53:22.022 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-24T21:53:22.024 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:22.062 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:22 +0000 (0:00:00.048) 0:04:30.951 ****** 2019-12-24T21:53:22.070 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-24T21:53:22.071 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:22.112 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:22 +0000 (0:00:00.049) 0:04:31.000 ****** 2019-12-24T21:53:22.134 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-12-24T21:53:22.160 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:22 +0000 (0:00:00.048) 0:04:31.049 ****** 2019-12-24T21:53:22.166 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-24T21:53:22.167 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:22.219 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:22 +0000 (0:00:00.058) 0:04:31.108 ****** 2019-12-24T21:53:22.221 INFO:teuthology.task.ansible.out: 2019-12-24T21:53:22.227 INFO:teuthology.task.ansible.out: 2019-12-24T21:53:22.229 INFO:teuthology.task.ansible.out:TASK [testnode : Set root disk] ************************************************ ok: [smithi124.front.sepia.ceph.com] => (item={u'block_used': 13037591, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286893, u'size_available': 930967113728, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966956, u'device': u'/dev/sda1', u'inode_used': 88020, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286893, "block_size": 4096, "block_total": 240324484, "block_used": 13037591, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966956, "inode_total": 61054976, "inode_used": 88020, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930967113728, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-12-24T21:53:22.268 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:22 +0000 (0:00:00.049) 0:04:31.157 ****** 2019-12-24T21:53:22.270 INFO:teuthology.task.ansible.out: 2019-12-24T21:53:22.275 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-24T21:53:22.276 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:22.315 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:22 +0000 (0:00:00.047) 0:04:31.204 ****** 2019-12-24T21:53:22.344 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-24T21:53:22.345 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:22.391 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:22 +0000 (0:00:00.075) 0:04:31.279 ****** 2019-12-24T21:53:22.409 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-24T21:53:22.409 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-12-24T21:53:22.454 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:22 +0000 (0:00:00.062) 0:04:31.342 ****** 2019-12-24T21:53:22.460 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-24T21:53:22.461 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:22.506 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:22 +0000 (0:00:00.052) 0:04:31.394 ****** 2019-12-24T21:53:22.533 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-24T21:53:22.535 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:22.571 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:22 +0000 (0:00:00.065) 0:04:31.460 ****** 2019-12-24T21:53:22.592 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-12-24T21:53:22.593 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.013651", "end": "2019-12-24 21:53:22.548875", "rc": 0, "start": "2019-12-24 21:53:22.535224", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:22.594 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:22.630 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:22 +0000 (0:00:00.058) 0:04:31.518 ****** 2019-12-24T21:53:22.665 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:22 +0000 (0:00:00.035) 0:04:31.554 ****** 2019-12-24T21:53:22.671 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-24T21:53:22.671 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:22.719 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:22 +0000 (0:00:00.054) 0:04:31.608 ****** 2019-12-24T21:53:22.727 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-12-24T21:53:22.728 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'block_used': 13037591, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286893, u'size_available': 930967113728, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966956, u'device': u'/dev/sda1', u'inode_used': 88020, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286893, "block_size": 4096, "block_total": 240324484, "block_used": 13037591, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966956, "inode_total": 61054976, "inode_used": 88020, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930967113728, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:22.767 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:22 +0000 (0:00:00.047) 0:04:31.656 ****** 2019-12-24T21:53:22.774 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-24T21:53:22.774 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:22.817 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:22 +0000 (0:00:00.050) 0:04:31.706 ****** 2019-12-24T21:53:22.826 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-12-24T21:53:22.827 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-24T21:53:22.828 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-24T21:53:22.871 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:22 +0000 (0:00:00.053) 0:04:31.759 ****** 2019-12-24T21:53:22.905 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:22 +0000 (0:00:00.033) 0:04:31.793 ****** 2019-12-24T21:53:22.910 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-24T21:53:22.912 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:22.951 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:22 +0000 (0:00:00.045) 0:04:31.838 ****** 2019-12-24T21:53:22.967 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-24T21:53:22.969 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5PE7R', u'wwn-0x5000c50091d1562a'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5PE7R', u'wwn': u'0x5000c50091d1562a', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5PE7R-part1', u'wwn-0x5000c50091d1562a-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5PE7R", "wwn-0x5000c50091d1562a"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5PE7R-part1", "wwn-0x5000c50091d1562a-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5PE7R", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-24T21:53:22.970 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50091d1562a"}}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:23.205 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-12-24T21:53:23.260 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:23 +0000 (0:00:00.309) 0:04:32.148 ****** 2019-12-24T21:53:23.297 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:23.336 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:23 +0000 (0:00:00.076) 0:04:32.224 ****** 2019-12-24T21:53:23.343 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-24T21:53:23.344 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-12-24T21:53:23.385 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:23 +0000 (0:00:00.048) 0:04:32.273 ****** 2019-12-24T21:53:23.392 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-24T21:53:23.394 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:23.433 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:23 +0000 (0:00:00.047) 0:04:32.321 ****** 2019-12-24T21:53:23.465 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:23.498 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:23 +0000 (0:00:00.065) 0:04:32.387 ****** 2019-12-24T21:53:23.525 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-24T21:53:23.528 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:23.570 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:23 +0000 (0:00:00.071) 0:04:32.458 ****** 2019-12-24T21:53:23.597 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-24T21:53:23.599 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:23.636 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:23 +0000 (0:00:00.066) 0:04:32.524 ****** 2019-12-24T21:53:23.676 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:23.724 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:23 +0000 (0:00:00.088) 0:04:32.613 ****** 2019-12-24T21:53:23.730 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-24T21:53:23.731 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-24T21:53:23.776 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:23 +0000 (0:00:00.051) 0:04:32.664 ****** 2019-12-24T21:53:23.782 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-24T21:53:23.788 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:23.852 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:23 +0000 (0:00:00.075) 0:04:32.740 ****** 2019-12-24T21:53:23.885 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-24T21:53:23.887 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:23.929 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:23 +0000 (0:00:00.072) 0:04:32.813 ****** 2019-12-24T21:53:23.951 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-24T21:53:23.953 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:23.992 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:23 +0000 (0:00:00.067) 0:04:32.880 ****** 2019-12-24T21:53:24.021 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-12-24T21:53:24.023 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:24.060 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:24 +0000 (0:00:00.067) 0:04:32.948 ****** 2019-12-24T21:53:24.087 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-12-24T21:53:24.089 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:24.126 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:24 +0000 (0:00:00.065) 0:04:33.014 ****** 2019-12-24T21:53:24.132 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-24T21:53:24.133 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-12-24T21:53:24.177 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:24 +0000 (0:00:00.050) 0:04:33.065 ****** 2019-12-24T21:53:24.184 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:24.227 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:24 +0000 (0:00:00.049) 0:04:33.115 ****** 2019-12-24T21:53:24.233 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-24T21:53:24.235 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:24.273 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:24 +0000 (0:00:00.045) 0:04:33.160 ****** 2019-12-24T21:53:24.278 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-24T21:53:24.280 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:24.320 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:24 +0000 (0:00:00.044) 0:04:33.205 ****** 2019-12-24T21:53:24.323 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-24T21:53:24.326 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:24.363 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:24 +0000 (0:00:00.045) 0:04:33.251 ****** 2019-12-24T21:53:24.369 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-12-24T21:53:24.371 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:24.407 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:24 +0000 (0:00:00.044) 0:04:33.296 ****** 2019-12-24T21:53:24.413 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-24T21:53:24.415 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:24.452 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:24 +0000 (0:00:00.044) 0:04:33.341 ****** 2019-12-24T21:53:24.459 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-12-24T21:53:24.460 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:24.497 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:24 +0000 (0:00:00.044) 0:04:33.385 ****** 2019-12-24T21:53:24.505 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:24.541 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:24 +0000 (0:00:00.043) 0:04:33.429 ****** 2019-12-24T21:53:24.549 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-12-24T21:53:24.551 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:24.586 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:24 +0000 (0:00:00.045) 0:04:33.474 ****** 2019-12-24T21:53:24.592 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-24T21:53:24.594 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:24.632 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:24 +0000 (0:00:00.044) 0:04:33.519 ****** 2019-12-24T21:53:24.635 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-12-24T21:53:24.637 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:24.674 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:24 +0000 (0:00:00.043) 0:04:33.562 ****** 2019-12-24T21:53:24.680 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-24T21:53:24.682 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:24.718 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:24 +0000 (0:00:00.044) 0:04:33.607 ****** 2019-12-24T21:53:24.725 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-12-24T21:53:24.726 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:24.764 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:24 +0000 (0:00:00.045) 0:04:33.653 ****** 2019-12-24T21:53:24.781 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:24.819 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:24 +0000 (0:00:00.054) 0:04:33.707 ****** 2019-12-24T21:53:24.827 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:24.864 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:24 +0000 (0:00:00.044) 0:04:33.752 ****** 2019-12-24T21:53:24.870 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-24T21:53:24.871 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:24.909 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:24 +0000 (0:00:00.045) 0:04:33.798 ****** 2019-12-24T21:53:24.916 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-12-24T21:53:24.918 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:24.956 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:24 +0000 (0:00:00.046) 0:04:33.845 ****** 2019-12-24T21:53:24.963 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-24T21:53:24.968 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:25.005 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:25 +0000 (0:00:00.048) 0:04:33.894 ****** 2019-12-24T21:53:25.014 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-12-24T21:53:25.016 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:25.054 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:25 +0000 (0:00:00.047) 0:04:33.942 ****** 2019-12-24T21:53:25.061 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:25.105 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:25 +0000 (0:00:00.051) 0:04:33.993 ****** 2019-12-24T21:53:25.111 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:25.151 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:25 +0000 (0:00:00.046) 0:04:34.040 ****** 2019-12-24T21:53:25.158 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-12-24T21:53:25.160 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:25.198 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:25 +0000 (0:00:00.046) 0:04:34.087 ****** 2019-12-24T21:53:25.205 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-24T21:53:25.207 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-12-24T21:53:25.245 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:25 +0000 (0:00:00.046) 0:04:34.133 ****** 2019-12-24T21:53:25.251 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-24T21:53:25.253 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:25.290 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:25 +0000 (0:00:00.044) 0:04:34.178 ****** 2019-12-24T21:53:25.296 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-12-24T21:53:25.297 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:25.309 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-12-24T21:53:25.312 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:25.321 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:25.333 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-24T21:53:25.335 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-Noa8Cc-Q409-nKnc-MMRa-amB2-UuFG-NDLc4n', u'nvme-INTEL_SSDPEDMD400G4_PHFT620401B8400BGN', u'nvme-nvme.8086-50484654363230343031423834303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'PHFT620401B8400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:02.053282", "end": "2019-12-24 21:53:25.273225", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Noa8Cc-Q409-nKnc-MMRa-amB2-UuFG-NDLc4n", "nvme-INTEL_SSDPEDMD400G4_PHFT620401B8400BGN", "nvme-nvme.8086-50484654363230343031423834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "PHFT620401B8400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:23.219 2019-12-24T21:53:25.337 INFO:teuthology.task.ansible.out:943", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-24T21:53:25.339 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi037.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:25.340 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:25.350 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:25.352 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:25.415 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:25 +0000 (0:00:00.125) 0:04:34.304 ****** 2019-12-24T21:53:25.458 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:25 +0000 (0:00:00.042) 0:04:34.347 ****** 2019-12-24T21:53:25.467 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-12-24T21:53:25.469 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:25.510 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:25 +0000 (0:00:00.052) 0:04:34.399 ****** 2019-12-24T21:53:25.538 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-12-24T21:53:25.540 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:25.587 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:25 +0000 (0:00:00.076) 0:04:34.475 ****** 2019-12-24T21:53:25.614 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:25.658 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:25 +0000 (0:00:00.071) 0:04:34.546 ****** 2019-12-24T21:53:25.665 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-12-24T21:53:25.666 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.008773", "end": "2019-12-24 21:53:25.610687", "rc": 0, "start": "2019-12-24 21:53:25.601914", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-12-24T21:53:25.733 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:25 +0000 (0:00:00.075) 0:04:34.622 ****** 2019-12-24T21:53:25.741 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-12-24T21:53:25.742 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:25.783 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:25 +0000 (0:00:00.050) 0:04:34.672 ****** 2019-12-24T21:53:25.789 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-12-24T21:53:25.791 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:25.858 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:25 +0000 (0:00:00.074) 0:04:34.747 ****** 2019-12-24T21:53:25.868 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-12-24T21:53:25.870 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:25.908 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:25 +0000 (0:00:00.049) 0:04:34.797 ****** 2019-12-24T21:53:25.914 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-12-24T21:53:25.916 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:25.953 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:25 +0000 (0:00:00.045) 0:04:34.842 ****** 2019-12-24T21:53:25.962 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-12-24T21:53:25.964 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:26.017 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:26 +0000 (0:00:00.063) 0:04:34.906 ****** 2019-12-24T21:53:26.025 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:26.063 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:26 +0000 (0:00:00.045) 0:04:34.952 ****** 2019-12-24T21:53:26.069 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-12-24T21:53:26.070 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:26.119 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:26 +0000 (0:00:00.055) 0:04:35.007 ****** 2019-12-24T21:53:26.130 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-12-24T21:53:26.131 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:26.175 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:26 +0000 (0:00:00.055) 0:04:35.063 ****** 2019-12-24T21:53:26.180 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-12-24T21:53:26.182 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:26.219 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:26 +0000 (0:00:00.044) 0:04:35.107 ****** 2019-12-24T21:53:26.257 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-12-24T21:53:26.260 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:26.301 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:26 +0000 (0:00:00.081) 0:04:35.189 ****** 2019-12-24T21:53:26.354 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-24T21:53:26.356 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-12-24T21:53:26.392 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:26 +0000 (0:00:00.091) 0:04:35.281 ****** 2019-12-24T21:53:26.446 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-12-24T21:53:26.456 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:26.457 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-12-24T21:53:26.470 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:26.470 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:26.481 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:26.492 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:26.493 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:26.537 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:26 +0000 (0:00:00.144) 0:04:35.425 ****** 2019-12-24T21:53:26.671 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-12-24T21:53:26.672 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-12-24T21:53:26.711 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:26 +0000 (0:00:00.174) 0:04:35.599 ****** 2019-12-24T21:53:26.718 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-12-24T21:53:26.719 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.005798", "end": "2019-12-24 21:53:26.664482", "rc": 0, "start": "2019-12-24 21:53:26.658684", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-12-24T21:53:26.776 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:26 +0000 (0:00:00.065) 0:04:35.665 ****** 2019-12-24T21:53:26.784 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-24T21:53:26.786 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-Ypmo2crgUHQ2HTDSLnZJpepymxsWqzjibOJfYWf4jC3zlx8CDH8tE0XpvzjBu9uW'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620401B8400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.068483", "end": "2019-12-24 21:53:26.695008", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Ypmo2crgUHQ2HTDSLnZJpepymxsWqzjibOJfYWf4jC3zlx8CDH8tE0XpvzjBu9uW"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620401B8400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:25.626525", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-24T21:53:26.787 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-24T21:53:26.789 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={u'block_used': 13037607, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286877, u'size_available': 930967048192, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966952, u'device': u'/dev/sda1', u'inode_used': 88024, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286877, "block_size": 4096, "block_total": 240324484, "block_used": 13037607, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966952, "inode_total": 61054976, "inode_used": 88024, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930967048192, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-12-24T21:53:26.827 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:26 +0000 (0:00:00.050) 0:04:35.715 ****** 2019-12-24T21:53:26.840 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:26.879 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:26 +0000 (0:00:00.049) 0:04:35.765 ****** 2019-12-24T21:53:26.915 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-12-24T21:53:26.917 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:26.957 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:26 +0000 (0:00:00.080) 0:04:35.846 ****** 2019-12-24T21:53:26.990 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-12-24T21:53:26.992 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:27.029 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:27 +0000 (0:00:00.071) 0:04:35.917 ****** 2019-12-24T21:53:27.058 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-12-24T21:53:27.069 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:27.095 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:27 +0000 (0:00:00.066) 0:04:35.984 ****** 2019-12-24T21:53:27.166 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-12-24T21:53:27.167 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.011628", "end": "2019-12-24 21:53:27.134504", "rc": 0, "start": "2019-12-24 21:53:27.122876", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:27.228 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:27 +0000 (0:00:00.130) 0:04:36.115 ****** 2019-12-24T21:53:27.268 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi037.front.sepia.ceph.com] => (item={u'block_used': 13037607, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286877, u'size_available': 930967048192, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966952, u'device': u'/dev/sda1', u'inode_used': 88024, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286877, "block_size": 4096, "block_total": 240324484, "block_used": 13037607, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966952, "inode_total": 61054976, "inode_used": 88024, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930967048192, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:27.311 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:27 +0000 (0:00:00.085) 0:04:36.200 ****** 2019-12-24T21:53:27.340 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-12-24T21:53:27.379 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:27 +0000 (0:00:00.067) 0:04:36.268 ****** 2019-12-24T21:53:27.424 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-24T21:53:27.425 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HRZS', u'wwn-0x5000c500871a25c9'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4HRZS', u'wwn': u'0x5000c500871a25c9', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HRZS-part1', u'wwn-0x5000c500871a25c9-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRZS", "wwn-0x5000c500871a25c9"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRZS-part1", "wwn-0x5000c500871a25c9-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HRZS", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-24T21:53:27.427 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c500871a25c9"}}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:27.597 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-12-24T21:53:27.599 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-12-24T21:53:27.640 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:27 +0000 (0:00:00.260) 0:04:36.528 ****** 2019-12-24T21:53:27.683 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-24T21:53:27.689 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={u'block_used': 13037610, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286874, u'size_available': 930967035904, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966952, u'device': u'/dev/sda1', u'inode_used': 88024, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286874, "block_size": 4096, "block_total": 240324484, "block_used": 13037610, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966952, "inode_total": 61054976, "inode_used": 88024, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930967035904, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-12-24T21:53:27.725 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:27 +0000 (0:00:00.085) 0:04:36.613 ****** 2019-12-24T21:53:28.046 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-12-24T21:53:28.047 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.014093", "end": "2019-12-24 21:53:28.021320", "rc": 0, "start": "2019-12-24 21:53:28.007227", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:28.085 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:28 +0000 (0:00:00.360) 0:04:36.974 ****** 2019-12-24T21:53:28.114 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-24T21:53:28.116 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-Ypmo2crgUHQ2HTDSLnZJpepymxsWqzjinuDR7YozkZsdGSRYKeRELfl0juSOe7g3'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620401B8400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.066217", "end": "2019-12-24 21:53:28.079896", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Ypmo2crgUHQ2HTDSLnZJpepymxsWqzjinuDR7YozkZsdGSRYKeRELfl0juSOe7g3"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620401B8400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:27.013679", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-24T21:53:28.128 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-12-24T21:53:28.130 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'block_used': 13037610, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286874, u'size_available': 930967035904, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966952, u'device': u'/dev/sda1', u'inode_used': 88024, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286874, "block_size": 4096, "block_total": 240324484, "block_used": 13037610, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966952, "inode_total": 61054976, "inode_used": 88024, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930967035904, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:28.168 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:28 +0000 (0:00:00.082) 0:04:37.057 ****** 2019-12-24T21:53:28.197 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-12-24T21:53:28.238 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:28 +0000 (0:00:00.070) 0:04:37.127 ****** 2019-12-24T21:53:28.280 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-24T21:53:28.281 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4J30S', u'wwn-0x5000c500871b60ff'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4J30S', u'wwn': u'0x5000c500871b60ff', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4J30S-part1', u'wwn-0x5000c500871b60ff-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J30S", "wwn-0x5000c500871b60ff"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J30S-part1", "wwn-0x5000c500871b60ff-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J30S", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-24T21:53:28.283 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c500871b60ff"}}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:29.488 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-Ypmo2crgUHQ2HTDSLnZJpepymxsWqzjiaqsuosMwYl6Zy9ZjSZB32PvyJwy1zfEr'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620401B8400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.059505", "end": "2019-12-24 21:53:29.454735", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Ypmo2crgUHQ2HTDSLnZJpepymxsWqzjiaqsuosMwYl6Zy9ZjSZB32PvyJwy1zfEr"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620401B8400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:28.395230", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-24T21:53:29.679 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-RFdOH0-X35H-16cD-C4RU-aiMk-lU4M-Hh1n19', u'nvme-INTEL_SSDPEDMD400G4_CVFT5331005T400BGN', u'nvme-nvme.8086-43564654353333313030355434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'CVFT5331005T400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.941093", "end": "2019-12-24 21:53:29.642151", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-RFdOH0-X35H-16cD-C4RU-aiMk-lU4M-Hh1n19", "nvme-INTEL_SSDPEDMD400G4_CVFT5331005T400BGN", "nvme-nvme.8086-43564654353333313030355434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "CVFT5331005T400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:27.701 2019-12-24T21:53:29.681 INFO:teuthology.task.ansible.out:058", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-24T21:53:30.547 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-Ipb9iN-0C7v-oEzv-2QfD-UeeS-2E1K-oQn4q8', u'nvme-INTEL_SSDPEDMD400G4_CVFT5330000H400BGN', u'nvme-nvme.8086-43564654353333303030304834303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'CVFT5330000H400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.947861", "end": "2019-12-24 21:53:30.514701", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Ipb9iN-0C7v-oEzv-2QfD-UeeS-2E1K-oQn4q8", "nvme-INTEL_SSDPEDMD400G4_CVFT5330000H400BGN", "nvme-nvme.8086-43564654353333303030304834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "CVFT5330000H400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:28.566 2019-12-24T21:53:30.549 INFO:teuthology.task.ansible.out:840", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-24T21:53:30.853 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-Ypmo2crgUHQ2HTDSLnZJpepymxsWqzjiGNr4eQbtD2y3MzsFfNHd3mnNg0N3ctTb'], u'uuids': [u'd3ebd196-4bbd-435b-9b74-2297e0c96ba6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620401B8400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.064491", "end": "2019-12-24 21:53:30.813003", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Ypmo2crgUHQ2HTDSLnZJpepymxsWqzjiGNr4eQbtD2y3MzsFfNHd3mnNg0N3ctTb"], "labels": [], "masters": [], "uuids": ["d3ebd196-4bbd-435b-9b74-2297e0c96ba6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "PHFT620401B8400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:29.748512", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-24T21:53:31.071 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-SJHeDJknIXLB7B3sSngjMwTYFTZzsTQX7kdnmpImY0ePui6NYZKOSXTK1A2VkR4h'], u'uuids': [u'd314b89b-3c4f-4540-a949-e98d8de2b5a6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT5331005T400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.070298", "end": "2019-12-24 21:53:31.028449", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-SJHeDJknIXLB7B3sSngjMwTYFTZzsTQX7kdnmpImY0ePui6NYZKOSXTK1A2VkR4h"], "labels": [], "masters": [], "uuids": ["d314b89b-3c4f-4540-a949-e98d8de2b5a6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT5331005T400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:29.958151", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-24T21:53:31.968 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-yDDohkZy0lvsG30R2rrXpqFy0oqa69Us61S407FojDn6pAyvjM6Zo0M2oEq31Dc1'], u'uuids': [u'af26f3f5-0150-425e-acf4-3d62d4913e1b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT5330000H400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.058389", "end": "2019-12-24 21:53:31.919690", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-yDDohkZy0lvsG30R2rrXpqFy0oqa69Us61S407FojDn6pAyvjM6Zo0M2oEq31Dc1"], "labels": [], "masters": [], "uuids": ["af26f3f5-0150-425e-acf4-3d62d4913e1b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT5330000H400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:30.861301", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-24T21:53:32.237 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-Ypmo2crgUHQ2HTDSLnZJpepymxsWqzjiF4GtyWiTzbQWTAJ4htUFXOOmPb5OfUXf'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620401B8400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.062728", "end": "2019-12-24 21:53:32.205497", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Ypmo2crgUHQ2HTDSLnZJpepymxsWqzjiF4GtyWiTzbQWTAJ4htUFXOOmPb5OfUXf"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620401B8400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:31.142769", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-24T21:53:32.308 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:32 +0000 (0:00:04.069) 0:04:41.196 ****** 2019-12-24T21:53:32.345 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-24T21:53:32.347 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5PE7R', u'wwn-0x5000c50091d1562a'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5PE7R', u'wwn': u'0x5000c50091d1562a', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5PE7R-part1', u'wwn-0x5000c50091d1562a-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5PE7R", "wwn-0x5000c50091d1562a"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5PE7R-part1", "wwn-0x5000c50091d1562a-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5PE7R", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-24T21:53:32.348 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50091d1562a"}}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:32.442 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-24T21:53:32.443 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-SJHeDJknIXLB7B3sSngjMwTYFTZzsTQXBRB3GhIdxxt8yZocEb1POCPKA8j3w5I0'], u'uuids': [u'f72dd8f6-7282-4fbb-8691-956b17375734']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT5331005T400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.061157", "end": "2019-12-24 21:53:32.410616", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-SJHeDJknIXLB7B3sSngjMwTYFTZzsTQXBRB3GhIdxxt8yZocEb1POCPKA8j3w5I0"], "labels": [], "masters": [], "uuids": ["f72dd8f6-7282-4fbb-8691-956b17375734"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT5331005T400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:31.349459", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-24T21:53:32.745 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-24T21:53:32.746 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-Noa8Cc-Q409-nKnc-MMRa-amB2-UuFG-NDLc4n', u'nvme-INTEL_SSDPEDMD400G4_PHFT620401B8400BGN', u'nvme-nvme.8086-50484654363230343031423834303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'PHFT620401B8400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.087724", "end": "2019-12-24 21:53:32.709087", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Noa8Cc-Q409-nKnc-MMRa-amB2-UuFG-NDLc4n", "nvme-INTEL_SSDPEDMD400G4_PHFT620401B8400BGN", "nvme-nvme.8086-50484654363230343031423834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "PHFT620401B8400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:32.621363", "stderr": 2019-12-24T21:53:32.747 INFO:teuthology.task.ansible.out: "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.0810333 s, 1.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0810333 s, 1.4 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:33.196 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-Ypmo2crgUHQ2HTDSLnZJpepymxsWqzjibOJfYWf4jC3zlx8CDH8tE0XpvzjBu9uW'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620401B8400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.167462", "end": "2019-12-24 21:53:33.172725", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Ypmo2crgUHQ2HTDSLnZJpepymxsWqzjibOJfYWf4jC3zlx8CDH8tE0XpvzjBu9uW"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620401B8400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:33.005263", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.16243 s, 710 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.16243 s, 710 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:33.369 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-24T21:53:33.370 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-yDDohkZy0lvsG30R2rrXpqFy0oqa69Us5dpnjlCUinafgPe4invfoXzWpxPoh81f'], u'uuids': [u'bcab63a4-543d-49c2-aa10-382908e28895']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT5330000H400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.071481", "end": "2019-12-24 21:53:33.327366", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-yDDohkZy0lvsG30R2rrXpqFy0oqa69Us5dpnjlCUinafgPe4invfoXzWpxPoh81f"], "labels": [], "masters": [], "uuids": ["bcab63a4-543d-49c2-aa10-382908e28895"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT5330000H400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:32.255885", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-24T21:53:33.631 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-24T21:53:33.632 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-Ypmo2crgUHQ2HTDSLnZJpepymxsWqzjinuDR7YozkZsdGSRYKeRELfl0juSOe7g3'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620401B8400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.175697", "end": "2019-12-24 21:53:33.607008", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Ypmo2crgUHQ2HTDSLnZJpepymxsWqzjinuDR7YozkZsdGSRYKeRELfl0juSOe7g3"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620401B8400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:33.431311", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.170355 s, 677 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.170355 s, 677 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:33.820 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-24T21:53:33.821 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-SJHeDJknIXLB7B3sSngjMwTYFTZzsTQXMnRSxR1Be6D1reaTXQRymq73DDwA2ll1'], u'uuids': [u'2ba5fd5f-cb17-4884-b1e2-57a75987bb27']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT5331005T400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.060014", "end": "2019-12-24 21:53:33.786378", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-SJHeDJknIXLB7B3sSngjMwTYFTZzsTQXMnRSxR1Be6D1reaTXQRymq73DDwA2ll1"], "labels": [], "masters": [], "uuids": ["2ba5fd5f-cb17-4884-b1e2-57a75987bb27"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT5331005T400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:32.726364", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-24T21:53:34.075 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-Ypmo2crgUHQ2HTDSLnZJpepymxsWqzjiaqsuosMwYl6Zy9ZjSZB32PvyJwy1zfEr'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620401B8400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.180407", "end": "2019-12-24 21:53:34.048285", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Ypmo2crgUHQ2HTDSLnZJpepymxsWqzjiaqsuosMwYl6Zy9ZjSZB32PvyJwy1zfEr"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620401B8400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:33.867878", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.174975 s, 659 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.174975 s, 659 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:34.565 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-Ypmo2crgUHQ2HTDSLnZJpepymxsWqzjiGNr4eQbtD2y3MzsFfNHd3mnNg0N3ctTb'], u'uuids': [u'd3ebd196-4bbd-435b-9b74-2297e0c96ba6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620401B8400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.175279", "end": "2019-12-24 21:53:34.528415", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Ypmo2crgUHQ2HTDSLnZJpepymxsWqzjiGNr4eQbtD2y3MzsFfNHd3mnNg0N3ctTb"], "labels": [], "masters": [], "uuids": ["d3ebd196-4bbd-435b-9b74-2297e0c96ba6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "PHFT620401B8400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:34.353136", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.169052 s, 682 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.169052 s, 682 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:34.749 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-24T21:53:34.750 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-yDDohkZy0lvsG30R2rrXpqFy0oqa69UspkW8ImOs3yiGg7Gv59R55PCnEytwMVDV'], u'uuids': [u'09fba944-a408-43f4-ba6f-865faecc08de']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT5330000H400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.052205", "end": "2019-12-24 21:53:34.704008", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-yDDohkZy0lvsG30R2rrXpqFy0oqa69UspkW8ImOs3yiGg7Gv59R55PCnEytwMVDV"], "labels": [], "masters": [], "uuids": ["09fba944-a408-43f4-ba6f-865faecc08de"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT5330000H400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:33.651803", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-24T21:53:35.064 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-24T21:53:35.066 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-Ypmo2crgUHQ2HTDSLnZJpepymxsWqzjiF4GtyWiTzbQWTAJ4htUFXOOmPb5OfUXf'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620401B8400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.190075", "end": "2019-12-24 21:53:35.027418", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Ypmo2crgUHQ2HTDSLnZJpepymxsWqzjiF4GtyWiTzbQWTAJ4htUFXOOmPb5OfUXf"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620401B8400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:34.837343", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.18332 s, 629 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.18332 s, 629 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:35.111 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:35 +0000 (0:00:02.803) 0:04:43.999 ****** 2019-12-24T21:53:35.199 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-24T21:53:35.200 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-SJHeDJknIXLB7B3sSngjMwTYFTZzsTQXaloePYE59xwR7QdYhUMXtOLy8e3qftCr'], u'uuids': [u'dfb6c2a1-d942-425b-a546-1d3db682464f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT5331005T400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.073352", "end": "2019-12-24 21:53:35.162857", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-SJHeDJknIXLB7B3sSngjMwTYFTZzsTQXaloePYE59xwR7QdYhUMXtOLy8e3qftCr"], "labels": [], "masters": [], "uuids": ["dfb6c2a1-d942-425b-a546-1d3db682464f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "CVFT5331005T400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:34.089505", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-24T21:53:35.503 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-12-24T21:53:35.505 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.084976", "end": "2019-12-24 21:53:35.468813", "rc": 0, "start": "2019-12-24 21:53:35.383837", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:35.553 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:35 +0000 (0:00:00.441) 0:04:44.441 ****** 2019-12-24T21:53:35.929 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-12-24T21:53:35.930 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.056049", "end": "2019-12-24 21:53:35.901215", "rc": 0, "start": "2019-12-24 21:53:35.845166", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:35.979 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:35 +0000 (0:00:00.426) 0:04:44.868 ****** 2019-12-24T21:53:36.010 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-12-24T21:53:36.055 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:36 +0000 (0:00:00.075) 0:04:44.943 ****** 2019-12-24T21:53:36.088 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-12-24T21:53:36.090 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:36.183 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:36 +0000 (0:00:00.128) 0:04:45.072 ****** 2019-12-24T21:53:36.189 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-24T21:53:36.191 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-yDDohkZy0lvsG30R2rrXpqFy0oqa69Usav8EwshRxfsZsaU6Y2lzhH0mMsKtzBPQ'], u'uuids': [u'a886ebfd-8902-44f9-87e0-d247344b5edd']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT5330000H400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.061687", "end": "2019-12-24 21:53:36.095795", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-yDDohkZy0lvsG30R2rrXpqFy0oqa69Usav8EwshRxfsZsaU6Y2lzhH0mMsKtzBPQ"], "labels": [], "masters": [], "uuids": ["a886ebfd-8902-44f9-87e0-d247344b5edd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "CVFT5330000H400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:35.034108", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-24T21:53:36.214 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-12-24T21:53:36.216 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:36.253 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:36 +0000 (0:00:00.069) 0:04:45.141 ****** 2019-12-24T21:53:36.281 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-24T21:53:36.282 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:36.345 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:36 +0000 (0:00:00.092) 0:04:45.234 ****** 2019-12-24T21:53:36.372 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-12-24T21:53:36.374 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:36.411 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:36 +0000 (0:00:00.065) 0:04:45.299 ****** 2019-12-24T21:53:36.635 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-24T21:53:36.636 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-SJHeDJknIXLB7B3sSngjMwTYFTZzsTQX84WcTsjFvxZLdcU9qVkCrGR2y0w8nCDj'], u'uuids': [u'625c21f6-b668-4681-a2bb-a533b2ab582c']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT5331005T400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.103521", "end": "2019-12-24 21:53:36.596253", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-SJHeDJknIXLB7B3sSngjMwTYFTZzsTQX84WcTsjFvxZLdcU9qVkCrGR2y0w8nCDj"], "labels": [], "masters": [], "uuids": ["625c21f6-b668-4681-a2bb-a533b2ab582c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT5331005T400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:35.492732", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-24T21:53:36.685 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:36 +0000 (0:00:00.274) 0:04:45.574 ****** 2019-12-24T21:53:36.739 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi037.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HRZS', u'wwn-0x5000c500871a25c9'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4HRZS', u'wwn': u'0x5000c500871a25c9', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HRZS-part1', u'wwn-0x5000c500871a25c9-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRZS", "wwn-0x5000c500871a25c9"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRZS-part1", "wwn-0x5000c500871a25c9-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": " 2019-12-24T21:53:36.740 INFO:teuthology.task.ansible.out:512", "serial": "Z1W4HRZS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a25c9"}}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:36.749 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-12-24T21:53:36.751 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-24T21:53:36.790 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:36 +0000 (0:00:00.104) 0:04:45.678 ****** 2019-12-24T21:53:36.850 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-24T21:53:36.850 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={u'block_used': 13037591, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286893, u'size_available': 930967113728, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966956, u'device': u'/dev/sda1', u'inode_used': 88020, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286893, "block_size": 4096, "block_total": 240324484, "block_used": 13037591, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966956, "inode_total": 61054976, "inode_used": 88020, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930967113728, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:36.890 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:36 +0000 (0:00:00.099) 0:04:45.778 ****** 2019-12-24T21:53:36.918 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-12-24T21:53:36.920 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:36.972 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:36 +0000 (0:00:00.077) 0:04:45.856 ****** 2019-12-24T21:53:36.998 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:37.039 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:37 +0000 (0:00:00.068) 0:04:45.925 ****** 2019-12-24T21:53:37.068 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-24T21:53:37.069 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:37.113 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:37 +0000 (0:00:00.073) 0:04:45.998 ****** 2019-12-24T21:53:37.138 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-12-24T21:53:37.139 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:37.140 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-24T21:53:37.141 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-RFdOH0-X35H-16cD-C4RU-aiMk-lU4M-Hh1n19', u'nvme-INTEL_SSDPEDMD400G4_CVFT5331005T400BGN', u'nvme-nvme.8086-43564654353333313030355434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'CVFT5331005T400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.088155", "end": "2019-12-24 21:53:37.109033", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-RFdOH0-X35H-16cD-C4RU-aiMk-lU4M-Hh1n19", "nvme-INTEL_SSDPEDMD400G4_CVFT5331005T400BGN", "nvme-nvme.8086-43564654353333313030355434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "CVFT5331005T400BGN", "size": "372.61 GB", "support_discard": "512", "vend 2019-12-24T21:53:37.142 INFO:teuthology.task.ansible.out:or": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:37.020878", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.0813769 s, 1.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0813769 s, 1.4 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:37.189 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:37 +0000 (0:00:00.079) 0:04:46.077 ****** 2019-12-24T21:53:37.216 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-12-24T21:53:37.218 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:37.256 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:37 +0000 (0:00:00.066) 0:04:46.144 ****** 2019-12-24T21:53:37.282 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-12-24T21:53:37.284 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:37.320 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:37 +0000 (0:00:00.064) 0:04:46.208 ****** 2019-12-24T21:53:37.566 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-24T21:53:37.567 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-yDDohkZy0lvsG30R2rrXpqFy0oqa69Usp2MGSgOIVkEjYfPSF6jcuk8d3rIg80xI'], u'uuids': [u'359d37f8-e005-4ca2-9260-824abbe497d7']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT5330000H400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.078448", "end": "2019-12-24 21:53:37.516397", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-yDDohkZy0lvsG30R2rrXpqFy0oqa69Usp2MGSgOIVkEjYfPSF6jcuk8d3rIg80xI"], "labels": [], "masters": [], "uuids": ["359d37f8-e005-4ca2-9260-824abbe497d7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT5330000H400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:36.437949", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-24T21:53:37.631 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:37 +0000 (0:00:00.311) 0:04:46.520 ****** 2019-12-24T21:53:37.659 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-24T21:53:37.661 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-SJHeDJknIXLB7B3sSngjMwTYFTZzsTQX7kdnmpImY0ePui6NYZKOSXTK1A2VkR4h'], u'uuids': [u'd314b89b-3c4f-4540-a949-e98d8de2b5a6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT5331005T400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.196474", "end": "2019-12-24 21:53:37.620899", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-SJHeDJknIXLB7B3sSngjMwTYFTZzsTQX7kdnmpImY0ePui6NYZKOSXTK1A2VkR4h"], "labels": [], "masters": [], "uuids": ["d314b89b-3c4f-4540-a949-e98d8de2b5a6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT5331005T400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:37.424425", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.190067 s, 607 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.190067 s, 607 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:37.695 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4J30S', u'wwn-0x5000c500871b60ff'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4J30S', u'wwn': u'0x5000c500871b60ff', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4J30S-part1', u'wwn-0x5000c500871b60ff-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J30S", "wwn-0x5000c500871b60ff"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J30S-part1", "wwn-0x5000c500871b60ff-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J30S", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-24T21:53:37.697 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c500871b60ff"}}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:38.090 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-Ipb9iN-0C7v-oEzv-2QfD-UeeS-2E1K-oQn4q8', u'nvme-INTEL_SSDPEDMD400G4_CVFT5330000H400BGN', u'nvme-nvme.8086-43564654353333303030304834303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'CVFT5330000H400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.079854", "end": "2019-12-24 21:53:38.057501", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Ipb9iN-0C7v-oEzv-2QfD-UeeS-2E1K-oQn4q8", "nvme-INTEL_SSDPEDMD400G4_CVFT5330000H400BGN", "nvme-nvme.8086-43564654353333303030304834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "CVFT5330000H400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:37.977647", "stderr": 2019-12-24T21:53:38.092 INFO:teuthology.task.ansible.out: "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.073106 s, 1.6 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.073106 s, 1.6 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:38.135 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-SJHeDJknIXLB7B3sSngjMwTYFTZzsTQXBRB3GhIdxxt8yZocEb1POCPKA8j3w5I0'], u'uuids': [u'f72dd8f6-7282-4fbb-8691-956b17375734']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT5331005T400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.162263", "end": "2019-12-24 21:53:38.107613", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-SJHeDJknIXLB7B3sSngjMwTYFTZzsTQXBRB3GhIdxxt8yZocEb1POCPKA8j3w5I0"], "labels": [], "masters": [], "uuids": ["f72dd8f6-7282-4fbb-8691-956b17375734"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT5331005T400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:37.945350", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.156499 s, 737 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.156499 s, 737 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:38.146 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-12-24T21:53:38.148 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-12-24T21:53:38.184 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:38 +0000 (0:00:00.552) 0:04:47.072 ****** 2019-12-24T21:53:38.585 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-24T21:53:38.588 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-yDDohkZy0lvsG30R2rrXpqFy0oqa69Us61S407FojDn6pAyvjM6Zo0M2oEq31Dc1'], u'uuids': [u'af26f3f5-0150-425e-acf4-3d62d4913e1b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT5330000H400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.168748", "end": "2019-12-24 21:53:38.546743", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-yDDohkZy0lvsG30R2rrXpqFy0oqa69Us61S407FojDn6pAyvjM6Zo0M2oEq31Dc1"], "labels": [], "masters": [], "uuids": ["af26f3f5-0150-425e-acf4-3d62d4913e1b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT5330000H400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:38.377995", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.16237 s, 710 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.16237 s, 710 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:38.620 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-SJHeDJknIXLB7B3sSngjMwTYFTZzsTQXMnRSxR1Be6D1reaTXQRymq73DDwA2ll1'], u'uuids': [u'2ba5fd5f-cb17-4884-b1e2-57a75987bb27']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT5331005T400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.181125", "end": "2019-12-24 21:53:38.591128", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-SJHeDJknIXLB7B3sSngjMwTYFTZzsTQXMnRSxR1Be6D1reaTXQRymq73DDwA2ll1"], "labels": [], "masters": [], "uuids": ["2ba5fd5f-cb17-4884-b1e2-57a75987bb27"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT5331005T400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:38.410003", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.174525 s, 661 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.174525 s, 661 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:38.988 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-24T21:53:39.022 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-24T21:53:39.026 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-yDDohkZy0lvsG30R2rrXpqFy0oqa69Us5dpnjlCUinafgPe4invfoXzWpxPoh81f'], u'uuids': [u'bcab63a4-543d-49c2-aa10-382908e28895']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT5330000H400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.177907", "end": "2019-12-24 21:53:38.993326", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-yDDohkZy0lvsG30R2rrXpqFy0oqa69Us5dpnjlCUinafgPe4invfoXzWpxPoh81f"], "labels": [], "masters": [], "uuids 2019-12-24T21:53:39.026 INFO:teuthology.task.ansible.out:": ["bcab63a4-543d-49c2-aa10-382908e28895"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT5330000H400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:38.815419", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.171913 s, 671 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.171913 s, 671 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:39.083 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-SJHeDJknIXLB7B3sSngjMwTYFTZzsTQXaloePYE59xwR7QdYhUMXtOLy8e3qftCr'], u'uuids': [u'dfb6c2a1-d942-425b-a546-1d3db682464f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT5331005T400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.167466", "end": "2019-12-24 21:53:39.054610", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-SJHeDJknIXLB7B3sSngjMwTYFTZzsTQXaloePYE59xwR7QdYhUMXtOLy8e3qftCr"], "labels": [], "masters": [], "uuids": ["dfb6c2a1-d942-425b-a546-1d3db682464f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "CVFT5331005T400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:38.887144", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.160901 s, 717 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.160901 s, 717 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:39.439 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-24T21:53:39.552 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-24T21:53:39.553 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-yDDohkZy0lvsG30R2rrXpqFy0oqa69UspkW8ImOs3yiGg7Gv59R55PCnEytwMVDV'], u'uuids': [u'09fba944-a408-43f4-ba6f-865faecc08de']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT5330000H400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.196180", "end": "2019-12-24 21:53:39.515067", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-yDDohkZy0lvsG30R2rrXpqFy0oqa69UspkW8ImOs3yiGg7Gv59R55PCnEytwMVDV"], "labels": [], "masters": [], "uuids": ["09fba944-a408-43f4-ba6f-865faecc08de"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT5330000H400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:39.318887", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.189973 s, 607 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.189973 s, 607 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:39.609 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-SJHeDJknIXLB7B3sSngjMwTYFTZzsTQX84WcTsjFvxZLdcU9qVkCrGR2y0w8nCDj'], u'uuids': [u'625c21f6-b668-4681-a2bb-a533b2ab582c']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT5331005T400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.202004", "end": "2019-12-24 21:53:39.571154", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-SJHeDJknIXLB7B3sSngjMwTYFTZzsTQX84WcTsjFvxZLdcU9qVkCrGR2y0w8nCDj"], "labels": [], "masters": [], "uuids": ["625c21f6-b668-4681-a2bb-a533b2ab582c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT5331005T400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:39.369150", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.19537 s, 590 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.19537 s, 590 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:39.656 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:39 +0000 (0:00:01.471) 0:04:48.544 ****** 2019-12-24T21:53:39.912 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-24T21:53:40.067 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-24T21:53:40.069 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-yDDohkZy0lvsG30R2rrXpqFy0oqa69Usav8EwshRxfsZsaU6Y2lzhH0mMsKtzBPQ'], u'uuids': [u'a886ebfd-8902-44f9-87e0-d247344b5edd']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT5330000H400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.198058", "end": "2019-12-24 21:53:40.026222", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-yDDohkZy0lvsG30R2rrXpqFy0oqa69Usav8EwshRxfsZsaU6Y2lzhH0mMsKtzBPQ"], "labels": [], "masters": [], "uuids" 2019-12-24T21:53:40.070 INFO:teuthology.task.ansible.out:: ["a886ebfd-8902-44f9-87e0-d247344b5edd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "CVFT5330000H400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:39.828164", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.191678 s, 602 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.191678 s, 602 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:40.100 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-12-24T21:53:40.101 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.086362", "end": "2019-12-24 21:53:40.029652", "rc": 0, "start": "2019-12-24 21:53:39.943290", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:40.161 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:40 +0000 (0:00:00.505) 0:04:49.050 ****** 2019-12-24T21:53:40.382 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-24T21:53:40.383 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-24T21:53:40.511 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.047467", "end": "2019-12-24 21:53:40.477150", "rc": 0, "start": "2019-12-24 21:53:40.429683", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:40.570 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:40 +0000 (0:00:00.408) 0:04:49.458 ****** 2019-12-24T21:53:40.579 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-24T21:53:40.581 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-yDDohkZy0lvsG30R2rrXpqFy0oqa69Usp2MGSgOIVkEjYfPSF6jcuk8d3rIg80xI'], u'uuids': [u'359d37f8-e005-4ca2-9260-824abbe497d7']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT5330000H400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.161772", "end": "2019-12-24 21:53:40.495765", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-yDDohkZy0lvsG30R2rrXpqFy0oqa69Usp2MGSgOIVkEjYfPSF6jcuk8d3rIg80xI"], "labels": [], "masters": [], "uuids": ["359d37f8-e005-4ca2-9260-824abbe497d7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT5330000H400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-24 21:53:40.333993", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.156348 s, 738 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.156348 s, 738 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:40.594 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-12-24T21:53:40.633 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:40 +0000 (0:00:00.062) 0:04:49.521 ****** 2019-12-24T21:53:40.676 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:40 +0000 (0:00:00.043) 0:04:49.565 ****** 2019-12-24T21:53:40.706 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-12-24T21:53:40.708 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:40.750 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:40 +0000 (0:00:00.073) 0:04:49.639 ****** 2019-12-24T21:53:40.789 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-12-24T21:53:40.790 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:40.829 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:40 +0000 (0:00:00.078) 0:04:49.717 ****** 2019-12-24T21:53:40.856 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-24T21:53:40.858 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:40.908 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:40 +0000 (0:00:00.079) 0:04:49.797 ****** 2019-12-24T21:53:40.916 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-24T21:53:40.917 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-24T21:53:40.960 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:40 +0000 (0:00:00.051) 0:04:49.849 ****** 2019-12-24T21:53:40.966 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-12-24T21:53:40.967 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:41.010 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:41 +0000 (0:00:00.049) 0:04:49.899 ****** 2019-12-24T21:53:41.049 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-12-24T21:53:41.052 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.089417", "end": "2019-12-24 21:53:41.016028", "rc": 0, "start": "2019-12-24 21:53:40.926611", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:41.093 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:41 +0000 (0:00:00.082) 0:04:49.982 ****** 2019-12-24T21:53:41.270 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-24T21:53:41.272 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-12-24T21:53:41.310 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:41 +0000 (0:00:00.217) 0:04:50.199 ****** 2019-12-24T21:53:41.328 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-12-24T21:53:41.330 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-24T21:53:41.370 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:41 +0000 (0:00:00.059) 0:04:50.258 ****** 2019-12-24T21:53:41.377 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-24T21:53:41.378 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:41.411 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-24T21:53:41.413 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={u'block_used': 13037607, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286877, u'size_available': 930967048192, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966952, u'device': u'/dev/sda1', u'inode_used': 88024, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286877, "block_size": 4096, "block_total": 240324484, "block_used": 13037607, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966952, "inode_total": 61054976, "inode_used": 88024, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930967048192, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:41.463 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:41 +0000 (0:00:00.092) 0:04:50.351 ****** 2019-12-24T21:53:41.469 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-12-24T21:53:41.470 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.053671", "end": "2019-12-24 21:53:41.433469", "rc": 0, "start": "2019-12-24 21:53:41.379798", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:41.512 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:41 +0000 (0:00:00.048) 0:04:50.400 ****** 2019-12-24T21:53:41.519 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-12-24T21:53:41.521 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:41.562 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:41 +0000 (0:00:00.048) 0:04:50.448 ****** 2019-12-24T21:53:41.570 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-12-24T21:53:41.614 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:41 +0000 (0:00:00.053) 0:04:50.502 ****** 2019-12-24T21:53:41.621 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-24T21:53:41.622 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:41.664 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:41 +0000 (0:00:00.048) 0:04:50.551 ****** 2019-12-24T21:53:41.673 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-12-24T21:53:41.674 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:41.675 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-24T21:53:41.723 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:41 +0000 (0:00:00.059) 0:04:50.610 ****** 2019-12-24T21:53:41.729 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-24T21:53:41.729 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:41.772 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:41 +0000 (0:00:00.049) 0:04:50.660 ****** 2019-12-24T21:53:41.779 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-12-24T21:53:41.780 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:41.819 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:41 +0000 (0:00:00.046) 0:04:50.707 ****** 2019-12-24T21:53:41.826 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-12-24T21:53:41.827 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:41.865 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:41 +0000 (0:00:00.046) 0:04:50.754 ****** 2019-12-24T21:53:41.872 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-24T21:53:41.874 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:41.915 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:41 +0000 (0:00:00.050) 0:04:50.804 ****** 2019-12-24T21:53:41.922 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-12-24T21:53:41.924 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:41.962 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:41 +0000 (0:00:00.046) 0:04:50.850 ****** 2019-12-24T21:53:41.969 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-12-24T21:53:41.970 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:42.010 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:42 +0000 (0:00:00.048) 0:04:50.899 ****** 2019-12-24T21:53:42.017 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-24T21:53:42.018 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-24T21:53:42.019 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:42.063 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:42 +0000 (0:00:00.052) 0:04:50.952 ****** 2019-12-24T21:53:42.293 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-24T21:53:42.294 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-24T21:53:42.332 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-12-24T21:53:42.334 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-24T21:53:42.379 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:42 +0000 (0:00:00.315) 0:04:51.267 ****** 2019-12-24T21:53:42.429 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-24T21:53:42.430 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={u'block_used': 13037610, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286874, u'size_available': 930967035904, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966952, u'device': u'/dev/sda1', u'inode_used': 88024, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286874, "block_size": 4096, "block_total": 240324484, "block_used": 13037610, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966952, "inode_total": 61054976, "inode_used": 88024, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930967035904, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:42.479 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:42 +0000 (0:00:00.100) 0:04:51.367 ****** 2019-12-24T21:53:42.519 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-12-24T21:53:42.521 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:42.567 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:42 +0000 (0:00:00.087) 0:04:51.455 ****** 2019-12-24T21:53:42.611 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-12-24T21:53:42.626 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-12-24T21:53:42.650 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:42 +0000 (0:00:00.082) 0:04:51.538 ****** 2019-12-24T21:53:42.656 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-24T21:53:42.658 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-24T21:53:42.660 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-24T21:53:42.704 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:42 +0000 (0:00:00.053) 0:04:51.592 ****** 2019-12-24T21:53:42.738 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:42 +0000 (0:00:00.034) 0:04:51.626 ****** 2019-12-24T21:53:42.743 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-24T21:53:42.744 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:42.786 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:42 +0000 (0:00:00.048) 0:04:51.674 ****** 2019-12-24T21:53:42.813 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-12-24T21:53:42.815 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:42.858 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:42 +0000 (0:00:00.071) 0:04:51.747 ****** 2019-12-24T21:53:42.885 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-12-24T21:53:42.889 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:42.925 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:42 +0000 (0:00:00.066) 0:04:51.813 ****** 2019-12-24T21:53:42.952 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-12-24T21:53:42.954 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:42.994 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:42 +0000 (0:00:00.069) 0:04:51.883 ****** 2019-12-24T21:53:43.053 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-12-24T21:53:43.054 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-24T21:53:43.091 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:43 +0000 (0:00:00.096) 0:04:51.980 ****** 2019-12-24T21:53:43.141 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi124.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-12-24T21:53:43.185 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:43 +0000 (0:00:00.093) 0:04:52.074 ****** 2019-12-24T21:53:43.192 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-24T21:53:43.197 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-24T21:53:43.570 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-12-24T21:53:43.572 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-12-24T21:53:43.608 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:43 +0000 (0:00:00.422) 0:04:52.496 ****** 2019-12-24T21:53:43.669 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-24T21:53:43.670 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-24T21:53:43.909 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-12-24T21:53:43.911 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"changed": true} 2019-12-24T21:53:43.951 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:43 +0000 (0:00:00.343) 0:04:52.840 ****** 2019-12-24T21:53:44.160 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-24T21:53:44.161 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-24T21:53:44.285 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-24T21:53:44.632 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-24T21:53:44.696 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi124.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-12-24T21:53:44.741 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:44 +0000 (0:00:00.789) 0:04:53.630 ****** 2019-12-24T21:53:44.769 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-24T21:53:44.771 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Add CPAN config directory for the teuthology user.] *********** skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:44.810 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:44 +0000 (0:00:00.068) 0:04:53.698 ****** 2019-12-24T21:53:44.837 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:44.879 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:44 +0000 (0:00:00.068) 0:04:53.767 ****** 2019-12-24T21:53:44.928 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-12-24T21:53:44.930 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:44.968 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:44 +0000 (0:00:00.089) 0:04:53.856 ****** 2019-12-24T21:53:44.994 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-12-24T21:53:44.996 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:45.033 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:45 +0000 (0:00:00.065) 0:04:53.922 ****** 2019-12-24T21:53:45.060 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-12-24T21:53:45.062 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:45.099 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:45 +0000 (0:00:00.065) 0:04:53.987 ****** 2019-12-24T21:53:45.115 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-24T21:53:45.117 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-24T21:53:45.158 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:45 +0000 (0:00:00.059) 0:04:54.046 ****** 2019-12-24T21:53:45.165 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-12-24T21:53:45.167 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:45.211 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:45 +0000 (0:00:00.053) 0:04:54.100 ****** 2019-12-24T21:53:45.242 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-12-24T21:53:45.243 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:45.288 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:45 +0000 (0:00:00.076) 0:04:54.177 ****** 2019-12-24T21:53:45.297 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-24T21:53:45.493 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-12-24T21:53:45.547 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:45 +0000 (0:00:00.257) 0:04:54.434 ****** 2019-12-24T21:53:45.586 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-24T21:53:45.587 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:45.773 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-24T21:53:45.774 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-24T21:53:45.806 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-12-24T21:53:45.808 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-12-24T21:53:45.843 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:45 +0000 (0:00:00.297) 0:04:54.732 ****** 2019-12-24T21:53:45.871 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-12-24T21:53:45.880 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:45.925 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:45 +0000 (0:00:00.081) 0:04:54.814 ****** 2019-12-24T21:53:45.930 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-24T21:53:45.931 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-24T21:53:45.954 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-12-24T21:53:45.955 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:46.021 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:46 +0000 (0:00:00.095) 0:04:54.910 ****** 2019-12-24T21:53:46.219 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-24T21:53:46.220 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-24T21:53:46.288 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-24T21:53:46.290 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-24T21:53:46.337 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:46 +0000 (0:00:00.315) 0:04:55.225 ****** 2019-12-24T21:53:46.558 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-24T21:53:46.559 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-24T21:53:46.674 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-24T21:53:46.676 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-12-24T21:53:46.714 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:46 +0000 (0:00:00.376) 0:04:55.602 ****** 2019-12-24T21:53:46.780 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-24T21:53:46.781 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:46.880 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-24T21:53:46.945 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:46 +0000 (0:00:00.230) 0:04:55.833 ****** 2019-12-24T21:53:46.951 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-12-24T21:53:46.952 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-12-24T21:53:46.997 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:46 +0000 (0:00:00.047) 0:04:55.881 ****** 2019-12-24T21:53:47.029 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-12-24T21:53:47.031 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:47.090 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:47 +0000 (0:00:00.097) 0:04:55.978 ****** 2019-12-24T21:53:47.106 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-24T21:53:47.108 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-24T21:53:47.293 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-12-24T21:53:47.295 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-24T21:53:47.330 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:47 +0000 (0:00:00.239) 0:04:56.218 ****** 2019-12-24T21:53:47.378 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-12-24T21:53:47.380 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-12-24T21:53:47.416 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:47 +0000 (0:00:00.086) 0:04:56.305 ****** 2019-12-24T21:53:47.423 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-24T21:53:47.424 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-24T21:53:47.613 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-12-24T21:53:47.615 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "syslog.target ntpdate.service tmp.mount systemd-journald.socket system.slice -.mount sntp.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "chronyd.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-12-24T21:53:47.617 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-12-24T21:53:47.618 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-24T21:53:47.653 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:47 +0000 (0:00:00.235) 0:04:56.541 ****** 2019-12-24T21:53:47.715 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-24T21:53:47.849 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-12-24T21:53:47.851 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true} 2019-12-24T21:53:47.887 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:47 +0000 (0:00:00.234) 0:04:56.775 ****** 2019-12-24T21:53:48.051 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-24T21:53:48.051 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-24T21:53:48.092 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:48 +0000 (0:00:00.205) 0:04:56.981 ****** 2019-12-24T21:53:48.344 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-12-24T21:53:48.345 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-12-24T21:53:48.386 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:48 +0000 (0:00:00.293) 0:04:57.275 ****** 2019-12-24T21:53:48.414 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-12-24T21:53:48.416 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:48.456 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:48 +0000 (0:00:00.069) 0:04:57.344 ****** 2019-12-24T21:53:48.469 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-24T21:53:48.505 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:48 +0000 (0:00:00.048) 0:04:57.393 ****** 2019-12-24T21:53:48.512 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-12-24T21:53:48.518 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:48.557 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:48 +0000 (0:00:00.052) 0:04:57.446 ****** 2019-12-24T21:53:48.567 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-12-24T21:53:48.568 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-12-24T21:53:48.605 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:48 +0000 (0:00:00.047) 0:04:57.493 ****** 2019-12-24T21:53:48.611 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-12-24T21:53:48.612 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-12-24T21:53:48.614 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:48.656 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:48 +0000 (0:00:00.051) 0:04:57.544 ****** 2019-12-24T21:53:48.692 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:48 +0000 (0:00:00.036) 0:04:57.581 ****** 2019-12-24T21:53:48.698 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-12-24T21:53:48.698 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:48.738 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:48 +0000 (0:00:00.046) 0:04:57.627 ****** 2019-12-24T21:53:48.744 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-12-24T21:53:48.746 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:48.784 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:48 +0000 (0:00:00.045) 0:04:57.672 ****** 2019-12-24T21:53:48.791 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-12-24T21:53:48.792 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:48.830 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:48 +0000 (0:00:00.046) 0:04:57.718 ****** 2019-12-24T21:53:48.839 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2019-12-24T21:53:48.840 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:48.876 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:48 +0000 (0:00:00.046) 0:04:57.765 ****** 2019-12-24T21:53:48.883 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-12-24T21:53:48.885 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:48.925 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:48 +0000 (0:00:00.048) 0:04:57.813 ****** 2019-12-24T21:53:48.953 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:48.993 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:48 +0000 (0:00:00.067) 0:04:57.881 ****** 2019-12-24T21:53:49.053 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-12-24T21:53:49.055 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true} 2019-12-24T21:53:49.096 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:49 +0000 (0:00:00.103) 0:04:57.984 ****** 2019-12-24T21:53:49.203 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-12-24T21:53:49.206 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-12-24T21:53:49.244 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:49 +0000 (0:00:00.147) 0:04:58.132 ****** 2019-12-24T21:53:49.481 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-12-24T21:53:49.521 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:49 +0000 (0:00:00.277) 0:04:58.409 ****** 2019-12-24T21:53:49.559 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-12-24T21:53:49.560 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:49.602 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:49 +0000 (0:00:00.080) 0:04:58.490 ****** 2019-12-24T21:53:49.608 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-12-24T21:53:49.609 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-12-24T21:53:49.648 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:49 +0000 (0:00:00.046) 0:04:58.536 ****** 2019-12-24T21:53:49.655 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:49.695 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:49 +0000 (0:00:00.047) 0:04:58.584 ****** 2019-12-24T21:53:49.702 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-12-24T21:53:49.705 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:49.741 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:49 +0000 (0:00:00.046) 0:04:58.630 ****** 2019-12-24T21:53:49.768 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-12-24T21:53:49.770 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:49.805 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:49 +0000 (0:00:00.064) 0:04:58.694 ****** 2019-12-24T21:53:49.832 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-12-24T21:53:49.834 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:49.879 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:49 +0000 (0:00:00.070) 0:04:58.764 ****** 2019-12-24T21:53:49.903 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-12-24T21:53:49.904 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:49.948 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:49 +0000 (0:00:00.072) 0:04:58.836 ****** 2019-12-24T21:53:49.974 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-12-24T21:53:49.975 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:50.014 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:50 +0000 (0:00:00.065) 0:04:58.902 ****** 2019-12-24T21:53:50.042 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-12-24T21:53:50.044 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:50.081 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:50 +0000 (0:00:00.067) 0:04:58.970 ****** 2019-12-24T21:53:50.118 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-12-24T21:53:50.120 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:50.163 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:50 +0000 (0:00:00.081) 0:04:59.051 ****** 2019-12-24T21:53:50.189 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-12-24T21:53:50.190 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-12-24T21:53:50.228 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:50 +0000 (0:00:00.065) 0:04:59.116 ****** 2019-12-24T21:53:50.644 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-12-24T21:53:50.645 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-12-24T21:53:50.647 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-12-24T21:53:50.689 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:50 +0000 (0:00:00.460) 0:04:59.577 ****** 2019-12-24T21:53:50.732 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:50 +0000 (0:00:00.042) 0:04:59.619 ****** 2019-12-24T21:53:50.857 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-12-24T21:53:50.858 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:51.015 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:51 +0000 (0:00:00.284) 0:04:59.903 ****** 2019-12-24T21:53:51.022 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:51.061 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:51 +0000 (0:00:00.046) 0:04:59.950 ****** 2019-12-24T21:53:51.066 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-12-24T21:53:51.067 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:51.106 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:51 +0000 (0:00:00.044) 0:04:59.994 ****** 2019-12-24T21:53:51.515 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-12-24T21:53:51.517 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "-.mount syslog.target basic.target ntpdate.service systemd-journald.socket sntp.service system.slice tmp.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "chronyd.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-12-24T21:53:51.518 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-12-24T21:53:51.520 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-24T21:53:51.556 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:51 +0000 (0:00:00.450) 0:05:00.445 ****** 2019-12-24T21:53:52.047 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-12-24T21:53:52.049 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-12-24T21:53:52.090 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:52 +0000 (0:00:00.534) 0:05:00.979 ****** 2019-12-24T21:53:52.100 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-12-24T21:53:52.101 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-12-24T21:53:52.143 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:52 +0000 (0:00:00.052) 0:05:01.031 ****** 2019-12-24T21:53:52.151 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-12-24T21:53:52.153 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:52.193 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:52 +0000 (0:00:00.050) 0:05:01.082 ****** 2019-12-24T21:53:52.199 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-12-24T21:53:52.199 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:52.240 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:52 +0000 (0:00:00.046) 0:05:01.129 ****** 2019-12-24T21:53:52.248 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-12-24T21:53:52.250 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-12-24T21:53:52.289 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:52 +0000 (0:00:00.048) 0:05:01.178 ****** 2019-12-24T21:53:52.485 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-12-24T21:53:52.487 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-12-24T21:53:52.525 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:52 +0000 (0:00:00.235) 0:05:01.413 ****** 2019-12-24T21:53:52.551 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-12-24T21:53:52.553 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:52.588 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:52 +0000 (0:00:00.062) 0:05:01.476 ****** 2019-12-24T21:53:52.614 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2019-12-24T21:53:52.616 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi124.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-12-24T21:53:52.655 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:52 +0000 (0:00:00.067) 0:05:01.544 ****** 2019-12-24T21:53:52.694 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:52 +0000 (0:00:00.039) 0:05:01.583 ****** 2019-12-24T21:53:52.721 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-12-24T21:53:52.723 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:52.763 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:52 +0000 (0:00:00.068) 0:05:01.652 ****** 2019-12-24T21:53:52.780 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-12-24T21:53:52.783 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "-.mount sntp.service systemd-journald.socket ntpdate.service basic.target system.slice tmp.mount syslog.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target multi-user.target chronyd.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-12-24T21:53:52.784 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-12-24T21:53:52.786 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-24T21:53:52.823 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:52 +0000 (0:00:00.059) 0:05:01.712 ****** 2019-12-24T21:53:52.830 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-12-24T21:53:52.831 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-12-24T21:53:52.873 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:52 +0000 (0:00:00.050) 0:05:01.762 ****** 2019-12-24T21:53:52.911 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-12-24T21:53:52.913 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:52.948 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:52 +0000 (0:00:00.074) 0:05:01.836 ****** 2019-12-24T21:53:52.998 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-12-24T21:53:52.999 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-12-24T21:53:53.042 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:53 +0000 (0:00:00.094) 0:05:01.930 ****** 2019-12-24T21:53:53.044 INFO:teuthology.task.ansible.out: 2019-12-24T21:53:53.279 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-12-24T21:53:53.280 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-12-24T21:53:53.331 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:53 +0000 (0:00:00.289) 0:05:02.220 ****** 2019-12-24T21:53:53.653 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-12-24T21:53:53.654 INFO:teuthology.task.ansible.out:changed: [smithi124.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-12-24T21:53:53.698 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:53 +0000 (0:00:00.366) 0:05:02.586 ****** 2019-12-24T21:53:53.726 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-12-24T21:53:53.728 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install python-pip on rpm based systems.] ********************* ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-12-24T21:53:53.770 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:53 +0000 (0:00:00.071) 0:05:02.658 ****** 2019-12-24T21:53:53.809 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:53 +0000 (0:00:00.039) 0:05:02.698 ****** 2019-12-24T21:53:53.814 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-12-24T21:53:53.816 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:53.885 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:53 +0000 (0:00:00.076) 0:05:02.774 ****** 2019-12-24T21:53:53.891 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-12-24T21:53:53.892 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:53.893 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi124.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:53.893 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:53.895 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:53.932 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:53 +0000 (0:00:00.045) 0:05:02.820 ****** 2019-12-24T21:53:53.937 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2019-12-24T21:53:53.937 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:53.976 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:53 +0000 (0:00:00.044) 0:05:02.864 ****** 2019-12-24T21:53:53.985 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi124.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:53.986 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:53.986 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:53.998 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-12-24T21:53:53.999 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi124.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:54.036 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:54 +0000 (0:00:00.059) 0:05:02.924 ****** 2019-12-24T21:53:54.042 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:54.087 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:54 +0000 (0:00:00.050) 0:05:02.975 ****** 2019-12-24T21:53:54.115 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-24T21:53:54.117 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:54.161 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:54 +0000 (0:00:00.073) 0:05:03.049 ****** 2019-12-24T21:53:54.188 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:54.229 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:54 +0000 (0:00:00.067) 0:05:03.117 ****** 2019-12-24T21:53:54.266 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-12-24T21:53:54.268 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:54.316 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:54 +0000 (0:00:00.086) 0:05:03.204 ****** 2019-12-24T21:53:54.324 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-12-24T21:53:54.325 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-12-24T21:53:54.371 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:54 +0000 (0:00:00.055) 0:05:03.259 ****** 2019-12-24T21:53:54.379 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:54.421 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:54 +0000 (0:00:00.049) 0:05:03.309 ****** 2019-12-24T21:53:54.447 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-12-24T21:53:54.449 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:54.492 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:54 +0000 (0:00:00.071) 0:05:03.380 ****** 2019-12-24T21:53:54.519 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-24T21:53:54.520 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:54.562 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:54 +0000 (0:00:00.070) 0:05:03.451 ****** 2019-12-24T21:53:54.601 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:54.642 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:54 +0000 (0:00:00.079) 0:05:03.531 ****** 2019-12-24T21:53:54.669 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-24T21:53:54.671 INFO:teuthology.task.ansible.out:skipping: [smithi124.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:54.710 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:54 +0000 (0:00:00.067) 0:05:03.598 ****** 2019-12-24T21:53:55.051 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-24T21:53:55.053 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.017201", "end": "2019-12-24 21:53:55.011599", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-12-24 21:53:54.994398", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:55.335 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-12-24T21:53:55.338 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-12-24T21:53:55.381 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:55 +0000 (0:00:00.671) 0:05:04.270 ****** 2019-12-24T21:53:55.392 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-24T21:53:55.394 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.008035", "end": "2019-12-24 21:53:55.343502", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-12-24 21:53:55.335467", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:55.452 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-12-24T21:53:55.453 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-12-24T21:53:55.496 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:55 +0000 (0:00:00.114) 0:05:04.384 ****** 2019-12-24T21:53:55.524 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-12-24T21:53:55.525 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:55.573 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:55 +0000 (0:00:00.076) 0:05:04.461 ****** 2019-12-24T21:53:55.601 INFO:teuthology.task.ansible.out: 2019-12-24T21:53:55.602 INFO:teuthology.task.ansible.out:TASK [testnode : Set interface] ************************************************ 2019-12-24T21:53:55.604 INFO:teuthology.task.ansible.out: ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2019-12-24T21:53:55.650 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:55 +0000 (0:00:00.077) 0:05:04.538 ****** 2019-12-24T21:53:55.651 INFO:teuthology.task.ansible.out: 2019-12-24T21:53:55.692 INFO:teuthology.task.ansible.out: 2019-12-24T21:53:55.694 INFO:teuthology.task.ansible.out:TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi124.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.007787", "end": "2019-12-24 21:53:55.655845", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-12-24 21:53:55.648058", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:55.970 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-12-24T21:53:56.013 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:56 +0000 (0:00:00.362) 0:05:04.901 ****** 2019-12-24T21:53:56.021 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-24T21:53:56.022 INFO:teuthology.task.ansible.out:ok: [smithi124.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.008110", "end": "2019-12-24 21:53:55.966211", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-12-24 21:53:55.958101", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:56.068 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:56 +0000 (0:00:00.054) 0:05:04.955 ****** 2019-12-24T21:53:56.074 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-12-24T21:53:56.075 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:56.117 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:56 +0000 (0:00:00.049) 0:05:05.005 ****** 2019-12-24T21:53:56.123 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-12-24T21:53:56.168 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:56 +0000 (0:00:00.051) 0:05:05.057 ****** 2019-12-24T21:53:56.174 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-12-24T21:53:56.175 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-12-24T21:53:56.217 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:56 +0000 (0:00:00.048) 0:05:05.105 ****** 2019-12-24T21:53:56.246 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-12-24T21:53:56.247 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:56.290 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:56 +0000 (0:00:00.073) 0:05:05.179 ****** 2019-12-24T21:53:56.500 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi124.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-24T21:53:56.610 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-12-24T21:53:56.612 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-12-24T21:53:56.648 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:56 +0000 (0:00:00.357) 0:05:05.536 ****** 2019-12-24T21:53:56.840 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-12-24T21:53:56.901 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:56 +0000 (0:00:00.253) 0:05:05.790 ****** 2019-12-24T21:53:56.930 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-12-24T21:53:56.932 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:56.969 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:56 +0000 (0:00:00.066) 0:05:05.857 ****** 2019-12-24T21:53:56.986 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-12-24T21:53:56.987 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-12-24T21:53:57.031 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:57 +0000 (0:00:00.062) 0:05:05.919 ****** 2019-12-24T21:53:57.039 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2019-12-24T21:53:57.090 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:57 +0000 (0:00:00.058) 0:05:05.978 ****** 2019-12-24T21:53:57.097 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:57.138 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:57 +0000 (0:00:00.048) 0:05:06.027 ****** 2019-12-24T21:53:57.188 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-12-24T21:53:57.190 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:57.192 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:57.204 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:57.205 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:57.216 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:57.259 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:57 +0000 (0:00:00.121) 0:05:06.148 ****** 2019-12-24T21:53:57.308 INFO:teuthology.task.ansible.out: 2019-12-24T21:53:57.309 INFO:teuthology.task.ansible.out:TASK [testnode : Define net_to_configure var] ********************************** 2019-12-24T21:53:57.309 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:57.322 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:57.323 INFO:teuthology.task.ansible.out: 2019-12-24T21:53:57.334 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:57.335 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:57.346 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:57.389 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:57 +0000 (0:00:00.129) 0:05:06.278 ****** 2019-12-24T21:53:57.427 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-12-24T21:53:57.429 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} TASK [testnode : set_fact] ***************************************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:57.492 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:57 +0000 (0:00:00.103) 0:05:06.381 ****** 2019-12-24T21:53:57.533 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:57 +0000 (0:00:00.039) 0:05:06.421 ****** 2019-12-24T21:53:57.538 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:57.578 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:57 +0000 (0:00:00.046) 0:05:06.467 ****** 2019-12-24T21:53:57.583 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-12-24T21:53:57.585 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:57.624 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:57 +0000 (0:00:00.045) 0:05:06.513 ****** 2019-12-24T21:53:57.629 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-12-24T21:53:57.630 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-12-24T21:53:57.668 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:57 +0000 (0:00:00.043) 0:05:06.557 ****** 2019-12-24T21:53:57.680 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:57.716 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:57 +0000 (0:00:00.048) 0:05:06.605 ****** 2019-12-24T21:53:57.722 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-12-24T21:53:57.724 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:57.762 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:57 +0000 (0:00:00.045) 0:05:06.650 ****** 2019-12-24T21:53:57.769 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-12-24T21:53:57.770 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:57.820 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:57 +0000 (0:00:00.049) 0:05:06.700 ****** 2019-12-24T21:53:57.839 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-12-24T21:53:57.841 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:57.885 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:57 +0000 (0:00:00.073) 0:05:06.773 ****** 2019-12-24T21:53:57.924 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-24T21:53:57.925 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:57.970 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:57 +0000 (0:00:00.084) 0:05:06.858 ****** 2019-12-24T21:53:57.998 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-12-24T21:53:58.000 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:58.041 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:58 +0000 (0:00:00.071) 0:05:06.929 ****** 2019-12-24T21:53:58.090 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-12-24T21:53:58.091 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-12-24T21:53:58.092 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:58.130 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:58 +0000 (0:00:00.088) 0:05:07.018 ****** 2019-12-24T21:53:58.169 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:58 +0000 (0:00:00.039) 0:05:07.057 ****** 2019-12-24T21:53:58.448 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-12-24T21:53:58.449 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-12-24T21:53:58.492 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:58 +0000 (0:00:00.322) 0:05:07.380 ****** 2019-12-24T21:53:58.515 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-24T21:53:58.516 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.015942", "end": "2019-12-24 21:53:58.468205", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-12-24 21:53:58.452263", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:58.558 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:58 +0000 (0:00:00.065) 0:05:07.446 ****** 2019-12-24T21:53:58.595 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-12-24T21:53:58.597 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:58.600 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:58.611 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:58.612 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2019-12-24T21:53:58.662 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:58 +0000 (0:00:00.104) 0:05:07.550 ****** 2019-12-24T21:53:58.702 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-12-24T21:53:58.704 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:58.720 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:58.730 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:58.772 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:58 +0000 (0:00:00.110) 0:05:07.660 ****** 2019-12-24T21:53:58.813 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-24T21:53:58.815 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:58.853 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:58 +0000 (0:00:00.081) 0:05:07.742 ****** 2019-12-24T21:53:58.859 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-24T21:53:58.860 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.007918", "end": "2019-12-24 21:53:58.791953", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-12-24 21:53:58.784035", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:58.882 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-12-24T21:53:58.883 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:58.919 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:58 +0000 (0:00:00.065) 0:05:07.807 ****** 2019-12-24T21:53:58.945 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-12-24T21:53:58.947 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:58.987 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:58 +0000 (0:00:00.068) 0:05:07.876 ****** 2019-12-24T21:53:59.013 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-12-24T21:53:59.015 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:59.057 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:59 +0000 (0:00:00.064) 0:05:07.940 ****** 2019-12-24T21:53:59.078 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-12-24T21:53:59.079 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:59.117 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:59 +0000 (0:00:00.064) 0:05:08.004 ****** 2019-12-24T21:53:59.145 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:59.189 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:59 +0000 (0:00:00.072) 0:05:08.077 ****** 2019-12-24T21:53:59.194 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-24T21:53:59.195 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.006913", "end": "2019-12-24 21:53:59.127266", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-12-24 21:53:59.120353", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:59.216 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:59.255 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:59 +0000 (0:00:00.066) 0:05:08.144 ****** 2019-12-24T21:53:59.281 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-24T21:53:59.283 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-24T21:53:59.319 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:59 +0000 (0:00:00.063) 0:05:08.207 ****** 2019-12-24T21:53:59.480 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-24T21:53:59.481 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.007952", "end": "2019-12-24 21:53:59.442610", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-12-24 21:53:59.434658", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:59.524 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:59 +0000 (0:00:00.204) 0:05:08.412 ****** 2019-12-24T21:53:59.552 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-12-24T21:53:59.592 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:53:59 +0000 (0:00:00.068) 0:05:08.480 ****** 2019-12-24T21:53:59.703 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-24T21:53:59.705 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.012447", "end": "2019-12-24 21:53:59.640360", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-12-24 21:53:59.627913", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:53:59.915 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-24T21:54:00.042 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-24T21:54:00.043 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.007606", "end": "2019-12-24 21:53:59.983436", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-12-24 21:53:59.975830", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:54:00.356 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.006947", "end": "2019-12-24 21:54:00.306313", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-12-24 21:54:00.299366", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-12-24T21:54:00.680 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.007850", "end": "2019-12-24 21:54:00.644078", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-12-24 21:54:00.636228", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-24T21:54:00.715 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:54:00 +0000 (0:00:01.123) 0:05:09.604 ****** 2019-12-24T21:54:00.748 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-12-24T21:54:00.794 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:54:00 +0000 (0:00:00.079) 0:05:09.683 ****** 2019-12-24T21:54:01.164 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-24T21:54:01.265 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2019-12-24T21:54:01.268 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2019-12-24T21:54:01.271 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** 2019-12-24T21:54:01.273 INFO:teuthology.task.ansible.out:skipping: no hosts matched PLAY RECAP ********************************************************************* smithi006.front.sepia.ceph.com : ok=121 changed=41 unreachable=0 failed=0 skipped=161 rescued=0 ignored=3 smithi037.front.sepia.ceph.com : ok=121 changed=41 unreachable=0 failed=0 skipped=161 rescued=0 ignored=3 smithi124.front.sepia.ceph.com : ok=121 changed=41 unreachable=0 failed=0 skipped=161 rescued=0 ignored=3 2019-12-24T21:54:01.273 INFO:teuthology.task.ansible.out:Tuesday 24 December 2019 21:54:01 +0000 (0:00:00.478) 0:05:10.161 ****** =============================================================================== 2019-12-24T21:54:01.275 INFO:teuthology.task.ansible.out:users : Create all admin users with sudo access. ----------------------- 37.35s users : Update authorized_keys using the keys repo --------------------- 34.28s common : nrpe - Ensure SELinux policy is up to date -------------------- 24.40s testnode : Install packages -------------------------------------------- 19.25s common : Update yum cache ---------------------------------------------- 15.33s users : Remove revoked users ------------------------------------------- 14.66s testnode : Zap all non-root disks --------------------------------------- 4.07s common : nrpe - Remove SELinux policy package --------------------------- 4.00s Gathering Facts --------------------------------------------------------- 3.30s common : nrpe - Load SELinux policy package ----------------------------- 3.21s ansible-managed : Add authorized keys for the ansible user. ------------- 3.00s testnode : Ensure ceph packages are not present. ------------------------ 2.67s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 1.49s common : Make sure smartmontools is installed --------------------------- 1.39s common : Configure epel repos in /etc/yum.repos.d/ ---------------------- 1.39s testnode : Ensure ceph dependency packages are not present. ------------- 1.13s common : Add krb5 config file ------------------------------------------- 1.06s common : nrpe - Copy SELinux type enforcement file ---------------------- 1.06s 2019-12-24T21:54:01.275 INFO:teuthology.task.ansible.out:Gathering Facts --------------------------------------------------------- 1.05s common : Upload nagios nrpe config. ------------------------------------- 0.85s 2019-12-24T21:54:01.566 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi124.front.sepia.ceph.com')] 2019-12-24T21:54:01.569 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-24T21:54:01.569 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi006.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:54:01.675 INFO:teuthology.orchestra.run.smithi006:> true 2019-12-24T21:54:02.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-24T21:54:02.079 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi037.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:54:02.185 INFO:teuthology.orchestra.run.smithi037:> true 2019-12-24T21:54:02.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-24T21:54:02.517 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi124.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T21:54:02.620 INFO:teuthology.orchestra.run.smithi124:> true 2019-12-24T21:54:02.995 INFO:teuthology.run_tasks:Running task clock... 2019-12-24T21:54:03.005 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2019-12-24T21:54:03.006 INFO:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-12-24T21:54:03.146 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-12-24T21:54:13.239 INFO:teuthology.orchestra.run.smithi006.stdout:ntpd: time slew -0.000356s 2019-12-24T21:54:13.278 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntp.service: Unit not found. 2019-12-24T21:54:13.360 INFO:teuthology.orchestra.run.smithi006.stdout: remote refid st t when poll reach delay offset jitter 2019-12-24T21:54:13.597 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================== 2019-12-24T21:54:13.598 INFO:teuthology.orchestra.run.smithi006.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-24T21:54:13.598 INFO:teuthology.orchestra.run.smithi006.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-24T21:54:13.598 INFO:teuthology.orchestra.run.smithi006.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-24T21:54:13.598 INFO:teuthology.orchestra.run.smithi006.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-24T21:54:13.599 INFO:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-12-24T21:54:13.741 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-12-24T21:54:23.830 INFO:teuthology.orchestra.run.smithi037.stdout:ntpd: time slew -0.001836s 2019-12-24T21:54:23.870 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit not found. 2019-12-24T21:54:23.957 INFO:teuthology.orchestra.run.smithi037.stdout: remote refid st t when poll reach delay offset jitter 2019-12-24T21:54:23.957 INFO:teuthology.orchestra.run.smithi037.stdout:============================================================================== 2019-12-24T21:54:23.957 INFO:teuthology.orchestra.run.smithi037.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-24T21:54:23.958 INFO:teuthology.orchestra.run.smithi037.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-24T21:54:23.958 INFO:teuthology.orchestra.run.smithi037.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-24T21:54:23.958 INFO:teuthology.orchestra.run.smithi037.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-24T21:54:23.959 INFO:teuthology.orchestra.run.smithi124:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-12-24T21:54:24.098 INFO:teuthology.orchestra.run.smithi124.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-12-24T21:54:34.195 INFO:teuthology.orchestra.run.smithi124.stdout:ntpd: time slew -0.000870s 2019-12-24T21:54:34.233 INFO:teuthology.orchestra.run.smithi124.stderr:Failed to start ntp.service: Unit not found. 2019-12-24T21:54:34.352 INFO:teuthology.orchestra.run.smithi124.stdout: remote refid st t when poll reach delay offset jitter 2019-12-24T21:54:34.353 INFO:teuthology.orchestra.run.smithi124.stdout:============================================================================== 2019-12-24T21:54:34.353 INFO:teuthology.orchestra.run.smithi124.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-24T21:54:34.353 INFO:teuthology.orchestra.run.smithi124.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-24T21:54:34.353 INFO:teuthology.orchestra.run.smithi124.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-24T21:54:34.353 INFO:teuthology.orchestra.run.smithi124.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-24T21:54:34.354 INFO:teuthology.run_tasks:Running task install... 2019-12-24T21:54:34.363 DEBUG:teuthology.task.install:project ceph 2019-12-24T21:54:34.363 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01'}} 2019-12-24T21:54:34.363 DEBUG:teuthology.task.install:config {'sha1': '7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01', 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'branch': 'nautilus', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs']} 2019-12-24T21:54:34.363 INFO:teuthology.task.install:Using flavor: basic 2019-12-24T21:54:34.372 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2019-12-24T21:54:34.373 INFO:teuthology.task.install:extra packages: ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'] 2019-12-24T21:54:34.373 INFO:teuthology.orchestra.run.smithi006:> sudo lsb_release -is 2019-12-24T21:54:34.545 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS 2019-12-24T21:54:34.547 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-24T21:54:34.548 INFO:teuthology.orchestra.run.smithi037:> sudo lsb_release -is 2019-12-24T21:54:34.548 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs'], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'branch': 'nautilus', 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'basic', 'extras': None} 2019-12-24T21:54:34.549 INFO:teuthology.orchestra.run.smithi006:> sudo lsb_release -is 2019-12-24T21:54:34.679 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS 2019-12-24T21:54:34.681 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-24T21:54:34.681 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-24T21:54:34.682 INFO:teuthology.packaging:ref: None 2019-12-24T21:54:34.682 INFO:teuthology.packaging:tag: None 2019-12-24T21:54:34.682 INFO:teuthology.packaging:branch: nautilus 2019-12-24T21:54:34.682 INFO:teuthology.packaging:sha1: 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 2019-12-24T21:54:34.682 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=nautilus 2019-12-24T21:54:34.715 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS 2019-12-24T21:54:34.717 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-24T21:54:34.717 INFO:teuthology.orchestra.run.smithi124:> sudo lsb_release -is 2019-12-24T21:54:34.717 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs'], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'branch': 'nautilus', 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'basic', 'extras': None} 2019-12-24T21:54:34.718 INFO:teuthology.orchestra.run.smithi037:> sudo lsb_release -is 2019-12-24T21:54:34.864 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS 2019-12-24T21:54:34.865 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS 2019-12-24T21:54:34.866 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-24T21:54:34.867 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs'], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'branch': 'nautilus', 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'basic', 'extras': None} 2019-12-24T21:54:34.867 INFO:teuthology.orchestra.run.smithi124:> sudo lsb_release -is 2019-12-24T21:54:34.868 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-24T21:54:34.868 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-24T21:54:34.868 INFO:teuthology.packaging:ref: None 2019-12-24T21:54:34.868 INFO:teuthology.packaging:tag: None 2019-12-24T21:54:34.869 INFO:teuthology.packaging:branch: nautilus 2019-12-24T21:54:34.869 INFO:teuthology.packaging:sha1: 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 2019-12-24T21:54:34.869 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=nautilus 2019-12-24T21:54:34.994 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS 2019-12-24T21:54:34.997 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-24T21:54:34.997 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-24T21:54:34.997 INFO:teuthology.packaging:ref: None 2019-12-24T21:54:34.997 INFO:teuthology.packaging:tag: None 2019-12-24T21:54:34.997 INFO:teuthology.packaging:branch: nautilus 2019-12-24T21:54:34.997 INFO:teuthology.packaging:sha1: 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 2019-12-24T21:54:34.998 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=nautilus 2019-12-24T21:54:35.054 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/nautilus/fd2fdc3e788d04a6ab2042decebf4fc032abd0a0/centos/7/flavors/default/ 2019-12-24T21:54:35.055 INFO:teuthology.task.install.rpm:Package version is 14.2.5-54.gfd2fdc3 2019-12-24T21:54:35.188 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/nautilus/fd2fdc3e788d04a6ab2042decebf4fc032abd0a0/centos/7/flavors/default/ 2019-12-24T21:54:35.189 INFO:teuthology.task.install.rpm:Package version is 14.2.5-54.gfd2fdc3 2019-12-24T21:54:35.198 INFO:teuthology.orchestra.run.smithi006:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-12-24T21:54:35.306 INFO:teuthology.orchestra.run.smithi037:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-12-24T21:54:35.322 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs on remote rpm x86_64 2019-12-24T21:54:35.322 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-24T21:54:35.323 INFO:teuthology.packaging:ref: None 2019-12-24T21:54:35.323 INFO:teuthology.packaging:tag: None 2019-12-24T21:54:35.323 INFO:teuthology.packaging:branch: nautilus 2019-12-24T21:54:35.323 INFO:teuthology.packaging:sha1: 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 2019-12-24T21:54:35.323 INFO:teuthology.orchestra.run.smithi006:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/nautilus/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-12-24T21:54:35.349 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/nautilus/fd2fdc3e788d04a6ab2042decebf4fc032abd0a0/centos/7/flavors/default/ 2019-12-24T21:54:35.350 INFO:teuthology.task.install.rpm:Package version is 14.2.5-54.gfd2fdc3 2019-12-24T21:54:35.424 INFO:teuthology.orchestra.run.smithi006:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-12-24T21:54:35.431 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs on remote rpm x86_64 2019-12-24T21:54:35.431 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-24T21:54:35.431 INFO:teuthology.packaging:ref: None 2019-12-24T21:54:35.431 INFO:teuthology.packaging:tag: None 2019-12-24T21:54:35.432 INFO:teuthology.packaging:branch: nautilus 2019-12-24T21:54:35.432 INFO:teuthology.packaging:sha1: 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 2019-12-24T21:54:35.432 INFO:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/nautilus/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-12-24T21:54:35.473 INFO:teuthology.orchestra.run.smithi124:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-12-24T21:54:35.534 INFO:teuthology.orchestra.run.smithi006:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-12-24T21:54:35.548 INFO:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-12-24T21:54:35.593 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs on remote rpm x86_64 2019-12-24T21:54:35.593 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-24T21:54:35.593 INFO:teuthology.packaging:ref: None 2019-12-24T21:54:35.593 INFO:teuthology.packaging:tag: None 2019-12-24T21:54:35.593 INFO:teuthology.packaging:branch: nautilus 2019-12-24T21:54:35.594 INFO:teuthology.packaging:sha1: 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 2019-12-24T21:54:35.594 INFO:teuthology.orchestra.run.smithi124:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/nautilus/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-12-24T21:54:35.608 INFO:teuthology.orchestra.run.smithi006.stdout:check_obsoletes = 1 2019-12-24T21:54:35.611 INFO:teuthology.orchestra.run.smithi006:> sudo yum clean all 2019-12-24T21:54:35.687 INFO:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-12-24T21:54:35.706 INFO:teuthology.orchestra.run.smithi124:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-12-24T21:54:35.790 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2019-12-24T21:54:35.793 INFO:teuthology.orchestra.run.smithi037:> sudo yum clean all 2019-12-24T21:54:35.834 INFO:teuthology.orchestra.run.smithi124:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-12-24T21:54:35.845 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:54:35.892 INFO:teuthology.orchestra.run.smithi006.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-12-24T21:54:35.892 INFO:teuthology.orchestra.run.smithi006.stdout: : lab-extras updates 2019-12-24T21:54:35.909 INFO:teuthology.orchestra.run.smithi124.stdout:check_obsoletes = 1 2019-12-24T21:54:35.911 INFO:teuthology.orchestra.run.smithi124:> sudo yum clean all 2019-12-24T21:54:35.941 INFO:teuthology.orchestra.run.smithi006.stdout:Cleaning up list of fastest mirrors 2019-12-24T21:54:35.942 INFO:teuthology.orchestra.run.smithi006.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-12-24T21:54:35.955 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-radosgw 2019-12-24T21:54:35.987 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:54:36.026 INFO:teuthology.orchestra.run.smithi037.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-12-24T21:54:36.027 INFO:teuthology.orchestra.run.smithi037.stdout: : lab-extras updates 2019-12-24T21:54:36.073 INFO:teuthology.orchestra.run.smithi037.stdout:Cleaning up list of fastest mirrors 2019-12-24T21:54:36.074 INFO:teuthology.orchestra.run.smithi037.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-12-24T21:54:36.077 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:54:36.087 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw 2019-12-24T21:54:36.117 INFO:teuthology.orchestra.run.smithi124.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-12-24T21:54:36.117 INFO:teuthology.orchestra.run.smithi124.stdout: : lab-extras updates 2019-12-24T21:54:36.117 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:54:36.152 INFO:teuthology.orchestra.run.smithi006.stdout:Determining fastest mirrors 2019-12-24T21:54:36.161 INFO:teuthology.orchestra.run.smithi124.stdout:Cleaning up list of fastest mirrors 2019-12-24T21:54:36.162 INFO:teuthology.orchestra.run.smithi124.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-12-24T21:54:36.174 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-radosgw 2019-12-24T21:54:36.316 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:54:36.361 INFO:teuthology.orchestra.run.smithi037.stdout:Determining fastest mirrors 2019-12-24T21:54:36.383 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:54:36.421 INFO:teuthology.orchestra.run.smithi124.stdout:Determining fastest mirrors 2019-12-24T21:54:36.777 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:54:36.778 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:54:36.778 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:54:36.779 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:54:36.899 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:54:36.899 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:54:36.900 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:54:36.901 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:54:37.091 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:54:37.092 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:54:37.092 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:54:37.093 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:54:44.299 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:54:44.397 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:54:44.664 INFO:teuthology.orchestra.run.smithi037.stdout:Resolving Dependencies 2019-12-24T21:54:44.664 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:54:44.665 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package ceph-radosgw.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.681 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: ceph-base = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.762 INFO:teuthology.orchestra.run.smithi006.stdout:Resolving Dependencies 2019-12-24T21:54:44.762 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:54:44.762 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package ceph-radosgw.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.778 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: ceph-base = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.793 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: ceph-selinux = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.793 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: librgw2 = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.795 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: librados2 = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.797 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.797 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.798 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.800 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: libceph-common.so.0()(64bit) for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.800 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:54:44.800 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package ceph-base.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.813 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: librbd1 = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.814 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: libcephfs2 = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.814 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: ceph-common = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.814 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-requests for package: 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.818 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.818 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.819 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package ceph-selinux.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.821 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-12-24T21:54:44.822 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-12-24T21:54:44.822 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-12-24T21:54:44.823 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package librados2.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be an update 2019-12-24T21:54:44.825 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package librgw2.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.826 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:54:44.826 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package ceph-common.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.831 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-rados = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.832 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-cephfs = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.833 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-rbd = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.834 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: libradosstriper1 = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.835 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-rgw = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.836 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-ceph-argparse = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.837 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.838 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.838 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.839 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.840 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-12-24T21:54:44.840 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package libcephfs2.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.840 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-12-24T21:54:44.841 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package librbd1.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be an update 2019-12-24T21:54:44.842 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-12-24T21:54:44.842 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-24T21:54:44.843 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-24T21:54:44.844 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-requests.noarch 0:2.6.0-8.el7_7 will be installed 2019-12-24T21:54:44.844 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-8.el7_7.noarch 2019-12-24T21:54:44.845 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:54:44.845 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-12-24T21:54:44.847 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package libradosstriper1.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.848 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-ceph-argparse.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.848 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-cephfs.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.849 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-12-24T21:54:44.849 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-rados.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.850 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-rbd.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.850 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-rgw.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.850 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-12-24T21:54:44.851 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-12-24T21:54:44.890 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: ceph-selinux = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.891 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: librgw2 = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.892 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: librados2 = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.894 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.894 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.896 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.897 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: libceph-common.so.0()(64bit) for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.898 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:54:44.898 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package ceph-base.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.908 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: librbd1 = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.909 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: libcephfs2 = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.911 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: ceph-common = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.912 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-requests for package: 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.914 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.915 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.916 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package ceph-selinux.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.919 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-12-24T21:54:44.920 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-12-24T21:54:44.920 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-12-24T21:54:44.921 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package librados2.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be an update 2019-12-24T21:54:44.923 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package librgw2.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.924 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:54:44.924 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package ceph-common.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.929 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-rados = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.930 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-cephfs = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.931 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-rbd = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.932 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: libradosstriper1 = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.933 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-rgw = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.934 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-ceph-argparse = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.935 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.936 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.936 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.937 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:44.938 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-12-24T21:54:44.938 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package libcephfs2.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.938 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-12-24T21:54:44.939 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package librbd1.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be an update 2019-12-24T21:54:44.940 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-12-24T21:54:44.941 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-24T21:54:44.941 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-24T21:54:44.942 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-requests.noarch 0:2.6.0-8.el7_7 will be installed 2019-12-24T21:54:44.943 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-8.el7_7.noarch 2019-12-24T21:54:44.943 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:54:44.944 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-12-24T21:54:44.945 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package libradosstriper1.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.946 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-ceph-argparse.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.946 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-cephfs.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.947 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-12-24T21:54:44.947 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-rados.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.948 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-rbd.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.948 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-rgw.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:44.948 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-12-24T21:54:44.949 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-12-24T21:54:45.059 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:54:45.413 INFO:teuthology.orchestra.run.smithi124.stdout:Resolving Dependencies 2019-12-24T21:54:45.414 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:54:45.414 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package ceph-radosgw.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:45.429 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: ceph-base = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.536 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: ceph-selinux = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.537 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: librgw2 = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.538 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: librados2 = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.539 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.540 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.541 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.542 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: libceph-common.so.0()(64bit) for package: 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.543 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:54:45.543 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package ceph-base.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:45.552 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: librbd1 = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.556 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: libcephfs2 = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.556 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: ceph-common = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.557 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-requests for package: 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.558 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.559 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.560 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package ceph-selinux.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:45.563 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-12-24T21:54:45.563 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-12-24T21:54:45.564 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-12-24T21:54:45.564 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package librados2.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be an update 2019-12-24T21:54:45.566 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package librgw2.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:45.567 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:54:45.567 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package ceph-common.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:45.571 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-rados = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.573 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-cephfs = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.573 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-rbd = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.574 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: libradosstriper1 = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.575 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-rgw = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.577 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-ceph-argparse = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.577 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.578 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.578 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.579 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:54:45.580 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-12-24T21:54:45.580 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package libcephfs2.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:45.581 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-12-24T21:54:45.581 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package librbd1.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be an update 2019-12-24T21:54:45.582 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-12-24T21:54:45.582 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-24T21:54:45.583 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-24T21:54:45.583 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-requests.noarch 0:2.6.0-8.el7_7 will be installed 2019-12-24T21:54:45.584 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-8.el7_7.noarch 2019-12-24T21:54:45.585 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:54:45.585 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-12-24T21:54:45.586 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package libradosstriper1.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:45.587 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-ceph-argparse.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:45.587 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-cephfs.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:45.588 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-12-24T21:54:45.588 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-rados.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:45.589 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-rbd.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:45.589 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-rgw.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:54:45.590 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-12-24T21:54:45.590 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-12-24T21:54:45.755 INFO:teuthology.orchestra.run.smithi037.stdout:--> Finished Dependency Resolution 2019-12-24T21:54:45.843 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:54:45.843 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies Resolved 2019-12-24T21:54:45.847 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:54:45.847 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:54:45.847 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2019-12-24T21:54:45.847 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:54:45.848 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2019-12-24T21:54:45.848 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 5.7 M 2019-12-24T21:54:45.848 INFO:teuthology.orchestra.run.smithi037.stdout:Installing for dependencies: 2019-12-24T21:54:45.848 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 5.3 M 2019-12-24T21:54:45.848 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 19 M 2019-12-24T21:54:45.849 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 19 k 2019-12-24T21:54:45.849 INFO:teuthology.orchestra.run.smithi037.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-12-24T21:54:45.849 INFO:teuthology.orchestra.run.smithi037.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-12-24T21:54:45.849 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 495 k 2019-12-24T21:54:45.849 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-12-24T21:54:45.850 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-12-24T21:54:45.850 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 357 k 2019-12-24T21:54:45.850 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 5.0 M 2019-12-24T21:54:45.850 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-12-24T21:54:45.851 INFO:teuthology.orchestra.run.smithi037.stdout: python-ceph-argparse x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 34 k 2019-12-24T21:54:45.851 INFO:teuthology.orchestra.run.smithi037.stdout: python-cephfs x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 94 k 2019-12-24T21:54:45.851 INFO:teuthology.orchestra.run.smithi037.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-12-24T21:54:45.851 INFO:teuthology.orchestra.run.smithi037.stdout: python-rados x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 198 k 2019-12-24T21:54:45.851 INFO:teuthology.orchestra.run.smithi037.stdout: python-rbd x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 180 k 2019-12-24T21:54:45.852 INFO:teuthology.orchestra.run.smithi037.stdout: python-requests noarch 2.6.0-8.el7_7 updates 95 k 2019-12-24T21:54:45.853 INFO:teuthology.orchestra.run.smithi037.stdout: python-rgw x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 77 k 2019-12-24T21:54:45.853 INFO:teuthology.orchestra.run.smithi037.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-12-24T21:54:45.853 INFO:teuthology.orchestra.run.smithi037.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-12-24T21:54:45.854 INFO:teuthology.orchestra.run.smithi037.stdout:Updating for dependencies: 2019-12-24T21:54:45.854 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 3.4 M 2019-12-24T21:54:45.854 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 1.7 M 2019-12-24T21:54:45.854 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:54:45.854 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2019-12-24T21:54:45.855 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:54:45.855 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package (+20 Dependent packages) 2019-12-24T21:54:45.855 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade ( 2 Dependent packages) 2019-12-24T21:54:45.855 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:54:45.855 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 42 M 2019-12-24T21:54:45.855 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading packages: 2019-12-24T21:54:45.856 INFO:teuthology.orchestra.run.smithi037.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-24T21:54:45.861 INFO:teuthology.orchestra.run.smithi006.stdout:--> Finished Dependency Resolution 2019-12-24T21:54:45.951 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:54:45.951 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies Resolved 2019-12-24T21:54:45.958 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:54:45.958 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:54:45.958 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2019-12-24T21:54:45.958 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:54:45.959 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2019-12-24T21:54:45.959 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 5.7 M 2019-12-24T21:54:45.959 INFO:teuthology.orchestra.run.smithi006.stdout:Installing for dependencies: 2019-12-24T21:54:45.959 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 5.3 M 2019-12-24T21:54:45.959 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 19 M 2019-12-24T21:54:45.960 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 19 k 2019-12-24T21:54:45.960 INFO:teuthology.orchestra.run.smithi006.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-12-24T21:54:45.960 INFO:teuthology.orchestra.run.smithi006.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-12-24T21:54:45.960 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2 x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 495 k 2019-12-24T21:54:45.961 INFO:teuthology.orchestra.run.smithi006.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-12-24T21:54:45.961 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-12-24T21:54:45.961 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1 x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 357 k 2019-12-24T21:54:45.961 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2 x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 5.0 M 2019-12-24T21:54:45.961 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-12-24T21:54:45.962 INFO:teuthology.orchestra.run.smithi006.stdout: python-ceph-argparse x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 34 k 2019-12-24T21:54:45.962 INFO:teuthology.orchestra.run.smithi006.stdout: python-cephfs x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 94 k 2019-12-24T21:54:45.962 INFO:teuthology.orchestra.run.smithi006.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-12-24T21:54:45.962 INFO:teuthology.orchestra.run.smithi006.stdout: python-rados x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 198 k 2019-12-24T21:54:45.963 INFO:teuthology.orchestra.run.smithi006.stdout: python-rbd x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 180 k 2019-12-24T21:54:45.963 INFO:teuthology.orchestra.run.smithi006.stdout: python-requests noarch 2.6.0-8.el7_7 updates 95 k 2019-12-24T21:54:45.963 INFO:teuthology.orchestra.run.smithi006.stdout: python-rgw x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 77 k 2019-12-24T21:54:45.963 INFO:teuthology.orchestra.run.smithi006.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-12-24T21:54:45.963 INFO:teuthology.orchestra.run.smithi006.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-12-24T21:54:45.964 INFO:teuthology.orchestra.run.smithi006.stdout:Updating for dependencies: 2019-12-24T21:54:45.964 INFO:teuthology.orchestra.run.smithi006.stdout: librados2 x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 3.4 M 2019-12-24T21:54:45.964 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1 x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 1.7 M 2019-12-24T21:54:45.964 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:54:45.965 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2019-12-24T21:54:45.965 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:54:45.965 INFO:teuthology.orchestra.run.smithi006.stdout:Install 1 Package (+20 Dependent packages) 2019-12-24T21:54:45.965 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrade ( 2 Dependent packages) 2019-12-24T21:54:45.966 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:54:45.966 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 42 M 2019-12-24T21:54:45.968 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading packages: 2019-12-24T21:54:45.968 INFO:teuthology.orchestra.run.smithi006.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-24T21:54:46.446 INFO:teuthology.orchestra.run.smithi124.stdout:--> Finished Dependency Resolution 2019-12-24T21:54:46.530 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:54:46.531 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies Resolved 2019-12-24T21:54:46.534 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:54:46.534 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:54:46.534 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2019-12-24T21:54:46.535 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:54:46.535 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2019-12-24T21:54:46.535 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-radosgw x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 5.7 M 2019-12-24T21:54:46.535 INFO:teuthology.orchestra.run.smithi124.stdout:Installing for dependencies: 2019-12-24T21:54:46.535 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-base x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 5.3 M 2019-12-24T21:54:46.536 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-common x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 19 M 2019-12-24T21:54:46.536 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-selinux x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 19 k 2019-12-24T21:54:46.536 INFO:teuthology.orchestra.run.smithi124.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-12-24T21:54:46.536 INFO:teuthology.orchestra.run.smithi124.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-12-24T21:54:46.537 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs2 x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 495 k 2019-12-24T21:54:46.537 INFO:teuthology.orchestra.run.smithi124.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-12-24T21:54:46.537 INFO:teuthology.orchestra.run.smithi124.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-12-24T21:54:46.537 INFO:teuthology.orchestra.run.smithi124.stdout: libradosstriper1 x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 357 k 2019-12-24T21:54:46.538 INFO:teuthology.orchestra.run.smithi124.stdout: librgw2 x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 5.0 M 2019-12-24T21:54:46.538 INFO:teuthology.orchestra.run.smithi124.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-12-24T21:54:46.538 INFO:teuthology.orchestra.run.smithi124.stdout: python-ceph-argparse x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 34 k 2019-12-24T21:54:46.538 INFO:teuthology.orchestra.run.smithi124.stdout: python-cephfs x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 94 k 2019-12-24T21:54:46.539 INFO:teuthology.orchestra.run.smithi124.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-12-24T21:54:46.539 INFO:teuthology.orchestra.run.smithi124.stdout: python-rados x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 198 k 2019-12-24T21:54:46.539 INFO:teuthology.orchestra.run.smithi124.stdout: python-rbd x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 180 k 2019-12-24T21:54:46.539 INFO:teuthology.orchestra.run.smithi124.stdout: python-requests noarch 2.6.0-8.el7_7 updates 95 k 2019-12-24T21:54:46.540 INFO:teuthology.orchestra.run.smithi124.stdout: python-rgw x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 77 k 2019-12-24T21:54:46.540 INFO:teuthology.orchestra.run.smithi124.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-12-24T21:54:46.540 INFO:teuthology.orchestra.run.smithi124.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-12-24T21:54:46.540 INFO:teuthology.orchestra.run.smithi124.stdout:Updating for dependencies: 2019-12-24T21:54:46.541 INFO:teuthology.orchestra.run.smithi124.stdout: librados2 x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 3.4 M 2019-12-24T21:54:46.541 INFO:teuthology.orchestra.run.smithi124.stdout: librbd1 x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 1.7 M 2019-12-24T21:54:46.541 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:54:46.541 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2019-12-24T21:54:46.542 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:54:46.542 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package (+20 Dependent packages) 2019-12-24T21:54:46.542 INFO:teuthology.orchestra.run.smithi124.stdout:Upgrade ( 2 Dependent packages) 2019-12-24T21:54:46.542 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:54:46.543 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 42 M 2019-12-24T21:54:46.543 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading packages: 2019-12-24T21:54:46.543 INFO:teuthology.orchestra.run.smithi124.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-24T21:54:48.668 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2019-12-24T21:54:48.668 INFO:teuthology.orchestra.run.smithi037.stdout:Total 15 MB/s | 42 MB 00:02 2019-12-24T21:54:48.688 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2019-12-24T21:54:48.767 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2019-12-24T21:54:48.996 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded 2019-12-24T21:54:48.997 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2019-12-24T21:54:49.740 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-12-24T21:54:49.909 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2019-12-24T21:54:49.909 INFO:teuthology.orchestra.run.smithi006.stdout:Total 11 MB/s | 42 MB 00:03 2019-12-24T21:54:49.928 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2019-12-24T21:54:50.004 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2019-12-24T21:54:50.027 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-12-24T21:54:50.242 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded 2019-12-24T21:54:50.243 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2019-12-24T21:54:50.284 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:python-ceph-argparse-14.2.5-54.gfd2fdc3.el7.x86_64 3/25 2019-12-24T21:54:50.612 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 4/25 2019-12-24T21:54:50.892 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-12-24T21:54:51.002 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 5/25 2019-12-24T21:54:51.081 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2019-12-24T21:54:51.081 INFO:teuthology.orchestra.run.smithi124.stdout:Total 9.2 MB/s | 42 MB 00:04 2019-12-24T21:54:51.097 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2019-12-24T21:54:51.164 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2019-12-24T21:54:51.201 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-12-24T21:54:51.383 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded 2019-12-24T21:54:51.384 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2019-12-24T21:54:51.477 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:python-ceph-argparse-14.2.5-54.gfd2fdc3.el7.x86_64 3/25 2019-12-24T21:54:51.790 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 6/25 2019-12-24T21:54:51.931 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 4/25 2019-12-24T21:54:52.097 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-12-24T21:54:52.145 INFO:teuthology.orchestra.run.smithi037.stdout: Updating : 2:librados2-14.2.5-54.gfd2fdc3.el7.x86_64 7/25 2019-12-24T21:54:52.417 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-12-24T21:54:52.539 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:python-rados-14.2.5-54.gfd2fdc3.el7.x86_64 8/25 2019-12-24T21:54:52.550 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 5/25 2019-12-24T21:54:52.740 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:python-ceph-argparse-14.2.5-54.gfd2fdc3.el7.x86_64 3/25 2019-12-24T21:54:53.109 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 4/25 2019-12-24T21:54:53.330 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 6/25 2019-12-24T21:54:53.378 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:libcephfs2-14.2.5-54.gfd2fdc3.el7.x86_64 9/25 2019-12-24T21:54:53.566 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 5/25 2019-12-24T21:54:53.717 INFO:teuthology.orchestra.run.smithi006.stdout: Updating : 2:librados2-14.2.5-54.gfd2fdc3.el7.x86_64 7/25 2019-12-24T21:54:53.860 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:librgw2-14.2.5-54.gfd2fdc3.el7.x86_64 10/25 2019-12-24T21:54:54.164 INFO:teuthology.orchestra.run.smithi037.stdout: Updating : 2:librbd1-14.2.5-54.gfd2fdc3.el7.x86_64 11/25 2019-12-24T21:54:54.215 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:python-rados-14.2.5-54.gfd2fdc3.el7.x86_64 8/25 2019-12-24T21:54:54.333 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 6/25 2019-12-24T21:54:54.422 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:python-rbd-14.2.5-54.gfd2fdc3.el7.x86_64 12/25 2019-12-24T21:54:54.702 INFO:teuthology.orchestra.run.smithi124.stdout: Updating : 2:librados2-14.2.5-54.gfd2fdc3.el7.x86_64 7/25 2019-12-24T21:54:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:python-rgw-14.2.5-54.gfd2fdc3.el7.x86_64 13/25 2019-12-24T21:54:55.035 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:python-cephfs-14.2.5-54.gfd2fdc3.el7.x86_64 14/25 2019-12-24T21:54:55.062 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:python-rados-14.2.5-54.gfd2fdc3.el7.x86_64 8/25 2019-12-24T21:54:55.097 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:libcephfs2-14.2.5-54.gfd2fdc3.el7.x86_64 9/25 2019-12-24T21:54:55.363 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:libradosstriper1-14.2.5-54.gfd2fdc3.el7.x86_64 15/25 2019-12-24T21:54:55.612 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:librgw2-14.2.5-54.gfd2fdc3.el7.x86_64 10/25 2019-12-24T21:54:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 16/25 2019-12-24T21:54:55.900 INFO:teuthology.orchestra.run.smithi006.stdout: Updating : 2:librbd1-14.2.5-54.gfd2fdc3.el7.x86_64 11/25 2019-12-24T21:54:55.990 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:libcephfs2-14.2.5-54.gfd2fdc3.el7.x86_64 9/25 2019-12-24T21:54:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 17/25 2019-12-24T21:54:56.127 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:python-rbd-14.2.5-54.gfd2fdc3.el7.x86_64 12/25 2019-12-24T21:54:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 18/25 2019-12-24T21:54:56.376 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:python-rgw-14.2.5-54.gfd2fdc3.el7.x86_64 13/25 2019-12-24T21:54:56.528 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:librgw2-14.2.5-54.gfd2fdc3.el7.x86_64 10/25 2019-12-24T21:54:56.728 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:python-cephfs-14.2.5-54.gfd2fdc3.el7.x86_64 14/25 2019-12-24T21:54:56.878 INFO:teuthology.orchestra.run.smithi124.stdout: Updating : 2:librbd1-14.2.5-54.gfd2fdc3.el7.x86_64 11/25 2019-12-24T21:54:57.024 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:libradosstriper1-14.2.5-54.gfd2fdc3.el7.x86_64 15/25 2019-12-24T21:54:57.188 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:python-rbd-14.2.5-54.gfd2fdc3.el7.x86_64 12/25 2019-12-24T21:54:57.339 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 16/25 2019-12-24T21:54:57.521 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:python-rgw-14.2.5-54.gfd2fdc3.el7.x86_64 13/25 2019-12-24T21:54:57.705 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 17/25 2019-12-24T21:54:57.883 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:python-cephfs-14.2.5-54.gfd2fdc3.el7.x86_64 14/25 2019-12-24T21:54:58.070 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 18/25 2019-12-24T21:54:58.237 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:libradosstriper1-14.2.5-54.gfd2fdc3.el7.x86_64 15/25 2019-12-24T21:54:58.503 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 16/25 2019-12-24T21:54:58.757 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python-requests-2.6.0-8.el7_7.noarch 19/25 2019-12-24T21:54:58.920 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 17/25 2019-12-24T21:54:59.325 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 18/25 2019-12-24T21:54:59.889 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 20/25 2019-12-24T21:55:00.451 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 21/25 2019-12-24T21:55:00.481 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python-requests-2.6.0-8.el7_7.noarch 19/25 2019-12-24T21:55:01.608 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 20/25 2019-12-24T21:55:01.828 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python-requests-2.6.0-8.el7_7.noarch 19/25 2019-12-24T21:55:02.116 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 21/25 2019-12-24T21:55:03.029 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 20/25 2019-12-24T21:55:03.662 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 21/25 2019-12-24T21:55:10.680 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:ceph-selinux-14.2.5-54.gfd2fdc3.el7.x86_64 22/25 2019-12-24T21:55:11.079 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 23/25 2019-12-24T21:55:11.334 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-24T21:55:11.604 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-24T21:55:11.718 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:libcephfs2-14.2.5-54.gfd2fdc3.el7.x86_64 1/25 2019-12-24T21:55:11.818 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:librgw2-14.2.5-54.gfd2fdc3.el7.x86_64 2/25 2019-12-24T21:55:11.927 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 3/25 2019-12-24T21:55:12.036 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:ceph-selinux-14.2.5-54.gfd2fdc3.el7.x86_64 4/25 2019-12-24T21:55:12.153 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:libradosstriper1-14.2.5-54.gfd2fdc3.el7.x86_64 5/25 2019-12-24T21:55:12.177 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:ceph-selinux-14.2.5-54.gfd2fdc3.el7.x86_64 22/25 2019-12-24T21:55:12.279 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 6/25 2019-12-24T21:55:12.404 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 7/25 2019-12-24T21:55:12.505 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 8/25 2019-12-24T21:55:12.605 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:python-cephfs-14.2.5-54.gfd2fdc3.el7.x86_64 9/25 2019-12-24T21:55:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 23/25 2019-12-24T21:55:12.714 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:python-rbd-14.2.5-54.gfd2fdc3.el7.x86_64 10/25 2019-12-24T21:55:12.806 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:librbd1-14.2.5-54.gfd2fdc3.el7.x86_64 11/25 2019-12-24T21:55:12.907 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:python-ceph-argparse-14.2.5-54.gfd2fdc3.el7.x86_64 12/25 2019-12-24T21:55:12.909 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-24T21:55:12.944 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:ceph-selinux-14.2.5-54.gfd2fdc3.el7.x86_64 22/25 2019-12-24T21:55:13.007 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 13/25 2019-12-24T21:55:13.091 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:librados2-14.2.5-54.gfd2fdc3.el7.x86_64 14/25 2019-12-24T21:55:13.183 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:python-rados-14.2.5-54.gfd2fdc3.el7.x86_64 15/25 2019-12-24T21:55:13.194 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-24T21:55:13.275 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:python-rgw-14.2.5-54.gfd2fdc3.el7.x86_64 16/25 2019-12-24T21:55:13.336 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:libcephfs2-14.2.5-54.gfd2fdc3.el7.x86_64 1/25 2019-12-24T21:55:13.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:librgw2-14.2.5-54.gfd2fdc3.el7.x86_64 2/25 2019-12-24T21:55:13.545 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 3/25 2019-12-24T21:55:13.637 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:ceph-selinux-14.2.5-54.gfd2fdc3.el7.x86_64 4/25 2019-12-24T21:55:13.721 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:libradosstriper1-14.2.5-54.gfd2fdc3.el7.x86_64 5/25 2019-12-24T21:55:13.838 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 6/25 2019-12-24T21:55:13.939 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 7/25 2019-12-24T21:55:14.031 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 8/25 2019-12-24T21:55:14.123 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:python-cephfs-14.2.5-54.gfd2fdc3.el7.x86_64 9/25 2019-12-24T21:55:14.232 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:python-rbd-14.2.5-54.gfd2fdc3.el7.x86_64 10/25 2019-12-24T21:55:14.236 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 23/25 2019-12-24T21:55:14.294 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 17/25 2019-12-24T21:55:14.375 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:librbd1-14.2.5-54.gfd2fdc3.el7.x86_64 11/25 2019-12-24T21:55:14.418 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 18/25 2019-12-24T21:55:14.500 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:python-ceph-argparse-14.2.5-54.gfd2fdc3.el7.x86_64 12/25 2019-12-24T21:55:14.519 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-requests-2.6.0-8.el7_7.noarch 19/25 2019-12-24T21:55:14.545 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-24T21:55:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 13/25 2019-12-24T21:55:14.628 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 20/25 2019-12-24T21:55:14.726 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:librados2-14.2.5-54.gfd2fdc3.el7.x86_64 14/25 2019-12-24T21:55:14.745 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 21/25 2019-12-24T21:55:14.843 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:python-rados-14.2.5-54.gfd2fdc3.el7.x86_64 15/25 2019-12-24T21:55:14.870 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 22/25 2019-12-24T21:55:14.880 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-24T21:55:14.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:python-rgw-14.2.5-54.gfd2fdc3.el7.x86_64 16/25 2019-12-24T21:55:14.979 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 23/25 2019-12-24T21:55:14.980 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-24T21:55:15.033 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:libcephfs2-14.2.5-54.gfd2fdc3.el7.x86_64 1/25 2019-12-24T21:55:15.094 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 17/25 2019-12-24T21:55:15.158 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:librgw2-14.2.5-54.gfd2fdc3.el7.x86_64 2/25 2019-12-24T21:55:15.220 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 18/25 2019-12-24T21:55:15.307 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python-requests-2.6.0-8.el7_7.noarch 19/25 2019-12-24T21:55:15.309 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 3/25 2019-12-24T21:55:15.361 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-24T21:55:15.362 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:15.362 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2019-12-24T21:55:15.362 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:15.362 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:15.362 INFO:teuthology.orchestra.run.smithi037.stdout:Dependency Installed: 2019-12-24T21:55:15.362 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:15.363 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:15.363 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:15.363 INFO:teuthology.orchestra.run.smithi037.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-12-24T21:55:15.363 INFO:teuthology.orchestra.run.smithi037.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-12-24T21:55:15.363 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:15.363 INFO:teuthology.orchestra.run.smithi037.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-12-24T21:55:15.363 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-12-24T21:55:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-12-24T21:55:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: python-ceph-argparse.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: python-cephfs.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-12-24T21:55:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: python-rados.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:15.365 INFO:teuthology.orchestra.run.smithi037.stdout: python-rbd.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:15.365 INFO:teuthology.orchestra.run.smithi037.stdout: python-requests.noarch 0:2.6.0-8.el7_7 2019-12-24T21:55:15.365 INFO:teuthology.orchestra.run.smithi037.stdout: python-rgw.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:15.365 INFO:teuthology.orchestra.run.smithi037.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-12-24T21:55:15.365 INFO:teuthology.orchestra.run.smithi037.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-12-24T21:55:15.365 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:15.365 INFO:teuthology.orchestra.run.smithi037.stdout:Dependency Updated: 2019-12-24T21:55:15.366 INFO:teuthology.orchestra.run.smithi037.stdout: librados2.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:15.366 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:15.366 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:15.366 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2019-12-24T21:55:15.388 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 20/25 2019-12-24T21:55:15.434 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:ceph-selinux-14.2.5-54.gfd2fdc3.el7.x86_64 4/25 2019-12-24T21:55:15.495 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-test 2019-12-24T21:55:15.513 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 21/25 2019-12-24T21:55:15.593 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:libradosstriper1-14.2.5-54.gfd2fdc3.el7.x86_64 5/25 2019-12-24T21:55:15.605 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 22/25 2019-12-24T21:55:15.694 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 6/25 2019-12-24T21:55:15.705 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 23/25 2019-12-24T21:55:15.707 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-24T21:55:15.794 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 7/25 2019-12-24T21:55:15.821 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:55:15.868 INFO:teuthology.orchestra.run.smithi037.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:55:15.869 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:55:15.870 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:55:15.870 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:55:15.870 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:55:15.913 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 8/25 2019-12-24T21:55:15.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:python-cephfs-14.2.5-54.gfd2fdc3.el7.x86_64 9/25 2019-12-24T21:55:16.072 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:python-rbd-14.2.5-54.gfd2fdc3.el7.x86_64 10/25 2019-12-24T21:55:16.097 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-24T21:55:16.097 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:16.097 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2019-12-24T21:55:16.098 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:16.098 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:16.098 INFO:teuthology.orchestra.run.smithi006.stdout:Dependency Installed: 2019-12-24T21:55:16.098 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:16.098 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:16.098 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:16.098 INFO:teuthology.orchestra.run.smithi006.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-12-24T21:55:16.099 INFO:teuthology.orchestra.run.smithi006.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-12-24T21:55:16.099 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:16.099 INFO:teuthology.orchestra.run.smithi006.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-12-24T21:55:16.099 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-12-24T21:55:16.099 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:16.099 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:16.099 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-12-24T21:55:16.100 INFO:teuthology.orchestra.run.smithi006.stdout: python-ceph-argparse.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:16.100 INFO:teuthology.orchestra.run.smithi006.stdout: python-cephfs.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:16.100 INFO:teuthology.orchestra.run.smithi006.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-12-24T21:55:16.100 INFO:teuthology.orchestra.run.smithi006.stdout: python-rados.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:16.100 INFO:teuthology.orchestra.run.smithi006.stdout: python-rbd.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:16.100 INFO:teuthology.orchestra.run.smithi006.stdout: python-requests.noarch 0:2.6.0-8.el7_7 2019-12-24T21:55:16.101 INFO:teuthology.orchestra.run.smithi006.stdout: python-rgw.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:16.101 INFO:teuthology.orchestra.run.smithi006.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-12-24T21:55:16.101 INFO:teuthology.orchestra.run.smithi006.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-12-24T21:55:16.101 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:16.101 INFO:teuthology.orchestra.run.smithi006.stdout:Dependency Updated: 2019-12-24T21:55:16.101 INFO:teuthology.orchestra.run.smithi006.stdout: librados2.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:16.101 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:16.102 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:16.102 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2019-12-24T21:55:16.205 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:librbd1-14.2.5-54.gfd2fdc3.el7.x86_64 11/25 2019-12-24T21:55:16.238 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-test 2019-12-24T21:55:16.331 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:python-ceph-argparse-14.2.5-54.gfd2fdc3.el7.x86_64 12/25 2019-12-24T21:55:16.490 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 13/25 2019-12-24T21:55:16.542 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:55:16.547 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:55:16.596 INFO:teuthology.orchestra.run.smithi006.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:55:16.596 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:55:16.596 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:55:16.596 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:55:16.597 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:55:16.601 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:librados2-14.2.5-54.gfd2fdc3.el7.x86_64 14/25 2019-12-24T21:55:16.749 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:python-rados-14.2.5-54.gfd2fdc3.el7.x86_64 15/25 2019-12-24T21:55:16.866 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:python-rgw-14.2.5-54.gfd2fdc3.el7.x86_64 16/25 2019-12-24T21:55:16.895 INFO:teuthology.orchestra.run.smithi037.stdout:Resolving Dependencies 2019-12-24T21:55:16.895 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:55:16.895 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package ceph-test.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:16.916 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:16.948 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: jq for package: 2:ceph-test-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:16.949 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: socat for package: 2:ceph-test-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:16.950 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:55:16.950 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-12-24T21:55:16.951 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-12-24T21:55:16.952 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-12-24T21:55:16.954 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-12-24T21:55:16.956 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:55:16.957 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-12-24T21:55:17.025 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 17/25 2019-12-24T21:55:17.151 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 18/25 2019-12-24T21:55:17.256 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:55:17.301 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python-requests-2.6.0-8.el7_7.noarch 19/25 2019-12-24T21:55:17.338 INFO:teuthology.orchestra.run.smithi037.stdout:--> Finished Dependency Resolution 2019-12-24T21:55:17.410 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 20/25 2019-12-24T21:55:17.567 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:17.567 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies Resolved 2019-12-24T21:55:17.567 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:17.568 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:55:17.568 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2019-12-24T21:55:17.568 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:55:17.568 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2019-12-24T21:55:17.568 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 34 M 2019-12-24T21:55:17.568 INFO:teuthology.orchestra.run.smithi037.stdout:Installing for dependencies: 2019-12-24T21:55:17.569 INFO:teuthology.orchestra.run.smithi037.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-12-24T21:55:17.569 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-12-24T21:55:17.569 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-12-24T21:55:17.569 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-12-24T21:55:17.569 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:17.569 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2019-12-24T21:55:17.569 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:55:17.570 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package (+4 Dependent packages) 2019-12-24T21:55:17.570 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:17.570 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:ceph-common-14.2.5-54.gfd2fdc3.el7.x86_64 21/25 2019-12-24T21:55:17.571 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 34 M 2019-12-24T21:55:17.571 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 118 M 2019-12-24T21:55:17.571 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading packages: 2019-12-24T21:55:17.614 INFO:teuthology.orchestra.run.smithi006.stdout:Resolving Dependencies 2019-12-24T21:55:17.615 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:55:17.615 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package ceph-test.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:17.636 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:17.653 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:ceph-radosgw-14.2.5-54.gfd2fdc3.el7.x86_64 22/25 2019-12-24T21:55:17.667 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: jq for package: 2:ceph-test-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:17.668 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: socat for package: 2:ceph-test-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:17.669 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:55:17.669 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-12-24T21:55:17.670 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-12-24T21:55:17.671 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-12-24T21:55:17.673 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-12-24T21:55:17.676 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:55:17.676 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-12-24T21:55:17.737 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 23/25 2019-12-24T21:55:17.738 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-24T21:55:18.057 INFO:teuthology.orchestra.run.smithi006.stdout:--> Finished Dependency Resolution 2019-12-24T21:55:18.095 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-24T21:55:18.095 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:18.095 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2019-12-24T21:55:18.095 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-radosgw.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:18.096 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:18.096 INFO:teuthology.orchestra.run.smithi124.stdout:Dependency Installed: 2019-12-24T21:55:18.096 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-base.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:18.096 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-common.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:18.096 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-selinux.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:18.096 INFO:teuthology.orchestra.run.smithi124.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-12-24T21:55:18.097 INFO:teuthology.orchestra.run.smithi124.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-12-24T21:55:18.097 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs2.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:18.097 INFO:teuthology.orchestra.run.smithi124.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-12-24T21:55:18.097 INFO:teuthology.orchestra.run.smithi124.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-12-24T21:55:18.097 INFO:teuthology.orchestra.run.smithi124.stdout: libradosstriper1.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:18.097 INFO:teuthology.orchestra.run.smithi124.stdout: librgw2.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:18.097 INFO:teuthology.orchestra.run.smithi124.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-12-24T21:55:18.097 INFO:teuthology.orchestra.run.smithi124.stdout: python-ceph-argparse.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:18.098 INFO:teuthology.orchestra.run.smithi124.stdout: python-cephfs.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:18.098 INFO:teuthology.orchestra.run.smithi124.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-12-24T21:55:18.098 INFO:teuthology.orchestra.run.smithi124.stdout: python-rados.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:18.098 INFO:teuthology.orchestra.run.smithi124.stdout: python-rbd.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:18.098 INFO:teuthology.orchestra.run.smithi124.stdout: python-requests.noarch 0:2.6.0-8.el7_7 2019-12-24T21:55:18.098 INFO:teuthology.orchestra.run.smithi124.stdout: python-rgw.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:18.098 INFO:teuthology.orchestra.run.smithi124.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-12-24T21:55:18.099 INFO:teuthology.orchestra.run.smithi124.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-12-24T21:55:18.099 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:18.099 INFO:teuthology.orchestra.run.smithi124.stdout:Dependency Updated: 2019-12-24T21:55:18.099 INFO:teuthology.orchestra.run.smithi124.stdout: librados2.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:18.099 INFO:teuthology.orchestra.run.smithi124.stdout: librbd1.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:18.099 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:18.099 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2019-12-24T21:55:18.243 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-test 2019-12-24T21:55:18.284 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:18.284 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies Resolved 2019-12-24T21:55:18.285 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:18.285 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:55:18.285 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2019-12-24T21:55:18.286 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:55:18.286 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2019-12-24T21:55:18.286 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 34 M 2019-12-24T21:55:18.286 INFO:teuthology.orchestra.run.smithi006.stdout:Installing for dependencies: 2019-12-24T21:55:18.286 INFO:teuthology.orchestra.run.smithi006.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-12-24T21:55:18.286 INFO:teuthology.orchestra.run.smithi006.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-12-24T21:55:18.286 INFO:teuthology.orchestra.run.smithi006.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-12-24T21:55:18.287 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-12-24T21:55:18.287 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:18.287 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2019-12-24T21:55:18.287 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:55:18.287 INFO:teuthology.orchestra.run.smithi006.stdout:Install 1 Package (+4 Dependent packages) 2019-12-24T21:55:18.287 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:18.288 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 34 M 2019-12-24T21:55:18.288 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 118 M 2019-12-24T21:55:18.288 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading packages: 2019-12-24T21:55:18.563 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:55:18.608 INFO:teuthology.orchestra.run.smithi124.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:55:18.609 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:55:18.610 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:55:18.610 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:55:18.610 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:55:19.258 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:55:19.357 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2019-12-24T21:55:19.357 INFO:teuthology.orchestra.run.smithi037.stdout:Total 19 MB/s | 34 MB 00:01 2019-12-24T21:55:19.362 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2019-12-24T21:55:19.407 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2019-12-24T21:55:19.504 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded 2019-12-24T21:55:19.505 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2019-12-24T21:55:19.597 INFO:teuthology.orchestra.run.smithi124.stdout:Resolving Dependencies 2019-12-24T21:55:19.597 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:55:19.597 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package ceph-test.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:19.617 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:19.647 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: jq for package: 2:ceph-test-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:19.647 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: socat for package: 2:ceph-test-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:19.649 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:55:19.649 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-12-24T21:55:19.649 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-12-24T21:55:19.650 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-12-24T21:55:19.652 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-12-24T21:55:19.655 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:55:19.655 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-12-24T21:55:20.014 INFO:teuthology.orchestra.run.smithi124.stdout:--> Finished Dependency Resolution 2019-12-24T21:55:20.149 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-12-24T21:55:20.234 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:20.234 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies Resolved 2019-12-24T21:55:20.235 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:20.235 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:55:20.236 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2019-12-24T21:55:20.236 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:55:20.236 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2019-12-24T21:55:20.236 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-test x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 34 M 2019-12-24T21:55:20.236 INFO:teuthology.orchestra.run.smithi124.stdout:Installing for dependencies: 2019-12-24T21:55:20.236 INFO:teuthology.orchestra.run.smithi124.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-12-24T21:55:20.237 INFO:teuthology.orchestra.run.smithi124.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-12-24T21:55:20.237 INFO:teuthology.orchestra.run.smithi124.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-12-24T21:55:20.237 INFO:teuthology.orchestra.run.smithi124.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-12-24T21:55:20.237 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:20.237 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2019-12-24T21:55:20.237 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:55:20.237 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package (+4 Dependent packages) 2019-12-24T21:55:20.238 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:20.238 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 34 M 2019-12-24T21:55:20.238 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 118 M 2019-12-24T21:55:20.238 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading packages: 2019-12-24T21:55:20.417 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-12-24T21:55:20.738 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-12-24T21:55:20.948 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2019-12-24T21:55:20.948 INFO:teuthology.orchestra.run.smithi006.stdout:Total 13 MB/s | 34 MB 00:02 2019-12-24T21:55:20.951 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2019-12-24T21:55:20.973 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2019-12-24T21:55:21.053 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded 2019-12-24T21:55:21.053 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2019-12-24T21:55:21.746 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-12-24T21:55:22.061 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-12-24T21:55:22.685 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2019-12-24T21:55:22.686 INFO:teuthology.orchestra.run.smithi124.stdout:Total 14 MB/s | 34 MB 00:02 2019-12-24T21:55:22.688 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2019-12-24T21:55:22.707 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-12-24T21:55:22.711 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2019-12-24T21:55:22.794 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded 2019-12-24T21:55:22.795 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2019-12-24T21:55:23.539 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-12-24T21:55:23.925 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-12-24T21:55:24.278 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-12-24T21:55:24.493 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-12-24T21:55:24.787 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:ceph-test-14.2.5-54.gfd2fdc3.el7.x86_64 5/5 2019-12-24T21:55:24.904 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:ceph-test-14.2.5-54.gfd2fdc3.el7.x86_64 1/5 2019-12-24T21:55:24.987 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 2/5 2019-12-24T21:55:25.113 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 3/5 2019-12-24T21:55:25.188 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-12-24T21:55:25.607 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-12-24T21:55:25.607 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:25.607 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2019-12-24T21:55:25.607 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:25.607 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:25.608 INFO:teuthology.orchestra.run.smithi037.stdout:Dependency Installed: 2019-12-24T21:55:25.608 INFO:teuthology.orchestra.run.smithi037.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-12-24T21:55:25.608 INFO:teuthology.orchestra.run.smithi037.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-12-24T21:55:25.608 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:25.608 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2019-12-24T21:55:25.741 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph 2019-12-24T21:55:25.965 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:55:26.005 INFO:teuthology.orchestra.run.smithi037.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:55:26.007 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:55:26.007 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:55:26.007 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:55:26.007 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:55:26.435 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-12-24T21:55:26.675 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:55:26.714 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:ceph-test-14.2.5-54.gfd2fdc3.el7.x86_64 5/5 2019-12-24T21:55:26.881 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:ceph-test-14.2.5-54.gfd2fdc3.el7.x86_64 1/5 2019-12-24T21:55:26.998 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 2/5 2019-12-24T21:55:27.016 INFO:teuthology.orchestra.run.smithi037.stdout:Resolving Dependencies 2019-12-24T21:55:27.017 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:55:27.017 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package ceph.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:27.019 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: ceph-mon = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:27.051 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: ceph-mgr = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:27.052 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: ceph-mds = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:27.053 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: ceph-osd = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:27.054 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:55:27.055 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package ceph-mds.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:27.068 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package ceph-mgr.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:27.070 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:27.071 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:27.072 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:27.073 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:27.074 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:27.075 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package ceph-mon.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:27.078 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package ceph-osd.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:27.083 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:55:27.083 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-12-24T21:55:27.084 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-12-24T21:55:27.085 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-12-24T21:55:27.086 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-24T21:55:27.087 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-24T21:55:27.088 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-24T21:55:27.089 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-24T21:55:27.090 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-12-24T21:55:27.090 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-12-24T21:55:27.091 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-12-24T21:55:27.091 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-12-24T21:55:27.092 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:55:27.092 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-12-24T21:55:27.093 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-12-24T21:55:27.093 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-12-24T21:55:27.095 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-12-24T21:55:27.095 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-12-24T21:55:27.095 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-12-24T21:55:27.095 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-12-24T21:55:27.096 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-12-24T21:55:27.096 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:55:27.096 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-12-24T21:55:27.096 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-12-24T21:55:27.098 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-12-24T21:55:27.098 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:55:27.098 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-12-24T21:55:27.098 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-12-24T21:55:27.098 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:55:27.098 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-12-24T21:55:27.124 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 3/5 2019-12-24T21:55:27.482 INFO:teuthology.orchestra.run.smithi037.stdout:--> Finished Dependency Resolution 2019-12-24T21:55:27.541 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-12-24T21:55:27.714 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:27.714 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies Resolved 2019-12-24T21:55:27.717 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:27.717 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:55:27.717 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository 2019-12-24T21:55:27.717 INFO:teuthology.orchestra.run.smithi037.stdout: Size 2019-12-24T21:55:27.717 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:55:27.717 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2019-12-24T21:55:27.718 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 1.9 k 2019-12-24T21:55:27.718 INFO:teuthology.orchestra.run.smithi037.stdout:Installing for dependencies: 2019-12-24T21:55:27.718 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 1.9 M 2019-12-24T21:55:27.718 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 1.6 M 2019-12-24T21:55:27.718 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 4.3 M 2019-12-24T21:55:27.718 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 16 M 2019-12-24T21:55:27.718 INFO:teuthology.orchestra.run.smithi037.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-12-24T21:55:27.719 INFO:teuthology.orchestra.run.smithi037.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-12-24T21:55:27.719 INFO:teuthology.orchestra.run.smithi037.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-12-24T21:55:27.719 INFO:teuthology.orchestra.run.smithi037.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-12-24T21:55:27.719 INFO:teuthology.orchestra.run.smithi037.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-12-24T21:55:27.719 INFO:teuthology.orchestra.run.smithi037.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-12-24T21:55:27.719 INFO:teuthology.orchestra.run.smithi037.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-12-24T21:55:27.719 INFO:teuthology.orchestra.run.smithi037.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-12-24T21:55:27.720 INFO:teuthology.orchestra.run.smithi037.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-12-24T21:55:27.720 INFO:teuthology.orchestra.run.smithi037.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-12-24T21:55:27.720 INFO:teuthology.orchestra.run.smithi037.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-12-24T21:55:27.720 INFO:teuthology.orchestra.run.smithi037.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-12-24T21:55:27.720 INFO:teuthology.orchestra.run.smithi037.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-12-24T21:55:27.720 INFO:teuthology.orchestra.run.smithi037.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-12-24T21:55:27.720 INFO:teuthology.orchestra.run.smithi037.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-12-24T21:55:27.720 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:27.721 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2019-12-24T21:55:27.721 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:55:27.721 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package (+19 Dependent packages) 2019-12-24T21:55:27.721 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:27.722 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 27 M 2019-12-24T21:55:27.722 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 85 M 2019-12-24T21:55:27.722 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading packages: 2019-12-24T21:55:27.869 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-12-24T21:55:28.060 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-12-24T21:55:28.061 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:28.061 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2019-12-24T21:55:28.061 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:28.061 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:28.061 INFO:teuthology.orchestra.run.smithi006.stdout:Dependency Installed: 2019-12-24T21:55:28.061 INFO:teuthology.orchestra.run.smithi006.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-12-24T21:55:28.061 INFO:teuthology.orchestra.run.smithi006.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-12-24T21:55:28.062 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:28.062 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2019-12-24T21:55:28.178 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:ceph-test-14.2.5-54.gfd2fdc3.el7.x86_64 5/5 2019-12-24T21:55:28.181 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph 2019-12-24T21:55:28.270 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:ceph-test-14.2.5-54.gfd2fdc3.el7.x86_64 1/5 2019-12-24T21:55:28.404 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 2/5 2019-12-24T21:55:28.437 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:55:28.482 INFO:teuthology.orchestra.run.smithi006.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:55:28.483 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:55:28.484 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:55:28.484 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:55:28.484 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:55:28.521 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 3/5 2019-12-24T21:55:28.672 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-12-24T21:55:29.145 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2019-12-24T21:55:29.146 INFO:teuthology.orchestra.run.smithi037.stdout:Total 19 MB/s | 27 MB 00:01 2019-12-24T21:55:29.156 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:55:29.169 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2019-12-24T21:55:29.218 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2019-12-24T21:55:29.506 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded 2019-12-24T21:55:29.506 INFO:teuthology.orchestra.run.smithi006.stdout:Resolving Dependencies 2019-12-24T21:55:29.506 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:55:29.507 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package ceph.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:29.507 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2019-12-24T21:55:29.509 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: ceph-mon = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:29.540 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: ceph-mgr = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:29.541 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: ceph-mds = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:29.542 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: ceph-osd = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:29.544 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:55:29.544 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package ceph-mds.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:29.548 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-12-24T21:55:29.548 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:29.548 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2019-12-24T21:55:29.548 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-test.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:29.549 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:29.549 INFO:teuthology.orchestra.run.smithi124.stdout:Dependency Installed: 2019-12-24T21:55:29.549 INFO:teuthology.orchestra.run.smithi124.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-12-24T21:55:29.549 INFO:teuthology.orchestra.run.smithi124.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-12-24T21:55:29.549 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:29.549 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2019-12-24T21:55:29.559 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package ceph-mgr.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:29.559 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:29.560 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:29.561 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:29.562 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:29.563 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:29.564 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package ceph-mon.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:29.567 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package ceph-osd.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:29.573 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:55:29.573 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-12-24T21:55:29.574 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-12-24T21:55:29.575 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-12-24T21:55:29.575 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-24T21:55:29.577 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-24T21:55:29.578 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-24T21:55:29.579 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-24T21:55:29.579 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-12-24T21:55:29.580 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-12-24T21:55:29.580 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-12-24T21:55:29.581 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-12-24T21:55:29.582 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:55:29.582 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-12-24T21:55:29.582 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-12-24T21:55:29.583 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-12-24T21:55:29.584 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-12-24T21:55:29.584 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-12-24T21:55:29.584 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-12-24T21:55:29.585 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-12-24T21:55:29.585 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-12-24T21:55:29.585 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:55:29.585 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-12-24T21:55:29.585 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-12-24T21:55:29.586 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-12-24T21:55:29.586 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:55:29.586 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-12-24T21:55:29.586 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-12-24T21:55:29.587 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:55:29.587 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-12-24T21:55:29.678 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph 2019-12-24T21:55:29.934 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:55:29.971 INFO:teuthology.orchestra.run.smithi006.stdout:--> Finished Dependency Resolution 2019-12-24T21:55:29.978 INFO:teuthology.orchestra.run.smithi124.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:55:29.978 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:55:29.979 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:55:29.979 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:55:29.979 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:55:30.205 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:30.205 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies Resolved 2019-12-24T21:55:30.208 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:30.208 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:55:30.209 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository 2019-12-24T21:55:30.209 INFO:teuthology.orchestra.run.smithi006.stdout: Size 2019-12-24T21:55:30.209 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:55:30.209 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2019-12-24T21:55:30.209 INFO:teuthology.orchestra.run.smithi006.stdout: ceph x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 1.9 k 2019-12-24T21:55:30.209 INFO:teuthology.orchestra.run.smithi006.stdout:Installing for dependencies: 2019-12-24T21:55:30.209 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 1.9 M 2019-12-24T21:55:30.210 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 1.6 M 2019-12-24T21:55:30.210 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 4.3 M 2019-12-24T21:55:30.210 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 16 M 2019-12-24T21:55:30.210 INFO:teuthology.orchestra.run.smithi006.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-12-24T21:55:30.210 INFO:teuthology.orchestra.run.smithi006.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-12-24T21:55:30.210 INFO:teuthology.orchestra.run.smithi006.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-12-24T21:55:30.210 INFO:teuthology.orchestra.run.smithi006.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-12-24T21:55:30.211 INFO:teuthology.orchestra.run.smithi006.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-12-24T21:55:30.211 INFO:teuthology.orchestra.run.smithi006.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-12-24T21:55:30.211 INFO:teuthology.orchestra.run.smithi006.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-12-24T21:55:30.211 INFO:teuthology.orchestra.run.smithi006.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-12-24T21:55:30.211 INFO:teuthology.orchestra.run.smithi006.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-12-24T21:55:30.211 INFO:teuthology.orchestra.run.smithi006.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-12-24T21:55:30.211 INFO:teuthology.orchestra.run.smithi006.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-12-24T21:55:30.212 INFO:teuthology.orchestra.run.smithi006.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-12-24T21:55:30.212 INFO:teuthology.orchestra.run.smithi006.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-12-24T21:55:30.212 INFO:teuthology.orchestra.run.smithi006.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-12-24T21:55:30.212 INFO:teuthology.orchestra.run.smithi006.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-12-24T21:55:30.212 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:30.212 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2019-12-24T21:55:30.212 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:55:30.212 INFO:teuthology.orchestra.run.smithi006.stdout:Install 1 Package (+19 Dependent packages) 2019-12-24T21:55:30.213 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:30.213 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 27 M 2019-12-24T21:55:30.213 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 85 M 2019-12-24T21:55:30.214 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading packages: 2019-12-24T21:55:30.455 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 1/20 2019-12-24T21:55:30.629 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:55:30.846 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python-webob-1.2.3-7.el7.noarch 2/20 2019-12-24T21:55:30.960 INFO:teuthology.orchestra.run.smithi124.stdout:Resolving Dependencies 2019-12-24T21:55:30.960 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:55:30.960 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package ceph.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:30.963 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: ceph-mon = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:30.992 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: ceph-mgr = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:30.993 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: ceph-mds = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:30.994 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: ceph-osd = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:30.996 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:55:30.996 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package ceph-mds.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:31.008 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package ceph-mgr.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:31.010 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:31.011 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:31.012 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:31.013 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:31.014 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 2019-12-24T21:55:31.015 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package ceph-mon.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:31.017 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package ceph-osd.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:31.026 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:55:31.026 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-12-24T21:55:31.026 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-12-24T21:55:31.027 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-12-24T21:55:31.027 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-24T21:55:31.027 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-24T21:55:31.027 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-24T21:55:31.028 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-24T21:55:31.029 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-12-24T21:55:31.029 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-12-24T21:55:31.030 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-12-24T21:55:31.030 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-12-24T21:55:31.031 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:55:31.031 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-12-24T21:55:31.031 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-12-24T21:55:31.032 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-12-24T21:55:31.037 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-12-24T21:55:31.037 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-12-24T21:55:31.037 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-12-24T21:55:31.037 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-12-24T21:55:31.037 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-12-24T21:55:31.038 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:55:31.038 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-12-24T21:55:31.038 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-12-24T21:55:31.038 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-12-24T21:55:31.038 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:55:31.038 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-12-24T21:55:31.038 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-12-24T21:55:31.039 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:55:31.039 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-12-24T21:55:31.394 INFO:teuthology.orchestra.run.smithi124.stdout:--> Finished Dependency Resolution 2019-12-24T21:55:31.564 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2019-12-24T21:55:31.564 INFO:teuthology.orchestra.run.smithi006.stdout:Total 20 MB/s | 27 MB 00:01 2019-12-24T21:55:31.589 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2019-12-24T21:55:31.614 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:31.614 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies Resolved 2019-12-24T21:55:31.616 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/20 2019-12-24T21:55:31.617 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:31.617 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:55:31.617 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository 2019-12-24T21:55:31.618 INFO:teuthology.orchestra.run.smithi124.stdout: Size 2019-12-24T21:55:31.618 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:55:31.618 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2019-12-24T21:55:31.618 INFO:teuthology.orchestra.run.smithi124.stdout: ceph x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 1.9 k 2019-12-24T21:55:31.618 INFO:teuthology.orchestra.run.smithi124.stdout:Installing for dependencies: 2019-12-24T21:55:31.618 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mds x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 1.9 M 2019-12-24T21:55:31.619 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 1.6 M 2019-12-24T21:55:31.619 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mon x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 4.3 M 2019-12-24T21:55:31.619 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-osd x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 16 M 2019-12-24T21:55:31.619 INFO:teuthology.orchestra.run.smithi124.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-12-24T21:55:31.619 INFO:teuthology.orchestra.run.smithi124.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-12-24T21:55:31.619 INFO:teuthology.orchestra.run.smithi124.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-12-24T21:55:31.619 INFO:teuthology.orchestra.run.smithi124.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-12-24T21:55:31.620 INFO:teuthology.orchestra.run.smithi124.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-12-24T21:55:31.620 INFO:teuthology.orchestra.run.smithi124.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-12-24T21:55:31.620 INFO:teuthology.orchestra.run.smithi124.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-12-24T21:55:31.620 INFO:teuthology.orchestra.run.smithi124.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-12-24T21:55:31.620 INFO:teuthology.orchestra.run.smithi124.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-12-24T21:55:31.620 INFO:teuthology.orchestra.run.smithi124.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-12-24T21:55:31.621 INFO:teuthology.orchestra.run.smithi124.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-12-24T21:55:31.621 INFO:teuthology.orchestra.run.smithi124.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-12-24T21:55:31.621 INFO:teuthology.orchestra.run.smithi124.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-12-24T21:55:31.621 INFO:teuthology.orchestra.run.smithi124.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-12-24T21:55:31.621 INFO:teuthology.orchestra.run.smithi124.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-12-24T21:55:31.621 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:31.622 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2019-12-24T21:55:31.622 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:55:31.622 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package (+19 Dependent packages) 2019-12-24T21:55:31.622 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:31.622 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 27 M 2019-12-24T21:55:31.622 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 85 M 2019-12-24T21:55:31.622 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading packages: 2019-12-24T21:55:31.640 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2019-12-24T21:55:31.883 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded 2019-12-24T21:55:31.883 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2019-12-24T21:55:32.019 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:ceph-mon-14.2.5-54.gfd2fdc3.el7.x86_64 4/20 2019-12-24T21:55:32.489 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 5/20 2019-12-24T21:55:32.944 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2019-12-24T21:55:32.944 INFO:teuthology.orchestra.run.smithi124.stdout:Total 20 MB/s | 27 MB 00:01 2019-12-24T21:55:32.959 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2019-12-24T21:55:32.994 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2019-12-24T21:55:33.167 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 1/20 2019-12-24T21:55:33.228 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded 2019-12-24T21:55:33.229 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2019-12-24T21:55:33.530 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python-webob-1.2.3-7.el7.noarch 2/20 2019-12-24T21:55:34.338 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/20 2019-12-24T21:55:34.433 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:ceph-mds-14.2.5-54.gfd2fdc3.el7.x86_64 6/20 2019-12-24T21:55:34.689 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 1/20 2019-12-24T21:55:34.772 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:ceph-mon-14.2.5-54.gfd2fdc3.el7.x86_64 4/20 2019-12-24T21:55:35.043 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:ceph-osd-14.2.5-54.gfd2fdc3.el7.x86_64 7/20 2019-12-24T21:55:35.076 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python-webob-1.2.3-7.el7.noarch 2/20 2019-12-24T21:55:35.255 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 5/20 2019-12-24T21:55:35.400 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 8/20 2019-12-24T21:55:35.831 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 9/20 2019-12-24T21:55:35.870 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/20 2019-12-24T21:55:36.217 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 10/20 2019-12-24T21:55:36.345 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:ceph-mon-14.2.5-54.gfd2fdc3.el7.x86_64 4/20 2019-12-24T21:55:36.489 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 11/20 2019-12-24T21:55:36.715 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-six-1.9.0-0.el7.noarch 12/20 2019-12-24T21:55:36.882 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 5/20 2019-12-24T21:55:37.145 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 13/20 2019-12-24T21:55:37.211 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:ceph-mds-14.2.5-54.gfd2fdc3.el7.x86_64 6/20 2019-12-24T21:55:37.486 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 14/20 2019-12-24T21:55:37.857 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 15/20 2019-12-24T21:55:37.933 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:ceph-osd-14.2.5-54.gfd2fdc3.el7.x86_64 7/20 2019-12-24T21:55:38.147 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python-mako-0.8.1-2.el7.noarch 16/20 2019-12-24T21:55:38.271 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 8/20 2019-12-24T21:55:38.579 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 17/20 2019-12-24T21:55:38.791 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 9/20 2019-12-24T21:55:38.868 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:ceph-mds-14.2.5-54.gfd2fdc3.el7.x86_64 6/20 2019-12-24T21:55:39.158 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 10/20 2019-12-24T21:55:39.232 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 18/20 2019-12-24T21:55:39.413 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 11/20 2019-12-24T21:55:39.540 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:ceph-osd-14.2.5-54.gfd2fdc3.el7.x86_64 7/20 2019-12-24T21:55:39.655 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 19/20 2019-12-24T21:55:39.676 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python2-six-1.9.0-0.el7.noarch 12/20 2019-12-24T21:55:39.893 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 8/20 2019-12-24T21:55:39.918 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:ceph-14.2.5-54.gfd2fdc3.el7.x86_64 20/20 2019-12-24T21:55:40.012 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 1/20 2019-12-24T21:55:40.118 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 13/20 2019-12-24T21:55:40.137 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 2/20 2019-12-24T21:55:40.246 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 3/20 2019-12-24T21:55:40.338 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 4/20 2019-12-24T21:55:40.426 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 9/20 2019-12-24T21:55:40.440 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 14/20 2019-12-24T21:55:40.455 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 5/20 2019-12-24T21:55:40.564 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 6/20 2019-12-24T21:55:40.673 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 7/20 2019-12-24T21:55:40.782 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 8/20 2019-12-24T21:55:40.804 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 10/20 2019-12-24T21:55:40.875 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 15/20 2019-12-24T21:55:40.907 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 9/20 2019-12-24T21:55:41.000 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 10/20 2019-12-24T21:55:41.095 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 11/20 2019-12-24T21:55:41.125 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:ceph-osd-14.2.5-54.gfd2fdc3.el7.x86_64 11/20 2019-12-24T21:55:41.233 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python-mako-0.8.1-2.el7.noarch 16/20 2019-12-24T21:55:41.234 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 12/20 2019-12-24T21:55:41.323 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python2-six-1.9.0-0.el7.noarch 12/20 2019-12-24T21:55:41.385 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 13/20 2019-12-24T21:55:41.510 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 14/20 2019-12-24T21:55:41.585 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:ceph-14.2.5-54.gfd2fdc3.el7.x86_64 15/20 2019-12-24T21:55:41.627 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 17/20 2019-12-24T21:55:41.669 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:ceph-mds-14.2.5-54.gfd2fdc3.el7.x86_64 16/20 2019-12-24T21:55:41.761 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 17/20 2019-12-24T21:55:41.841 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 13/20 2019-12-24T21:55:41.861 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 18/20 2019-12-24T21:55:41.954 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 19/20 2019-12-24T21:55:42.270 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 14/20 2019-12-24T21:55:42.286 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 18/20 2019-12-24T21:55:42.390 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:ceph-mon-14.2.5-54.gfd2fdc3.el7.x86_64 20/20 2019-12-24T21:55:42.390 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:42.391 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2019-12-24T21:55:42.391 INFO:teuthology.orchestra.run.smithi037.stdout: ceph.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:42.391 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:42.391 INFO:teuthology.orchestra.run.smithi037.stdout:Dependency Installed: 2019-12-24T21:55:42.391 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:42.391 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:42.391 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:42.392 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:42.392 INFO:teuthology.orchestra.run.smithi037.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-12-24T21:55:42.392 INFO:teuthology.orchestra.run.smithi037.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-12-24T21:55:42.392 INFO:teuthology.orchestra.run.smithi037.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-12-24T21:55:42.392 INFO:teuthology.orchestra.run.smithi037.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-12-24T21:55:42.392 INFO:teuthology.orchestra.run.smithi037.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-12-24T21:55:42.392 INFO:teuthology.orchestra.run.smithi037.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-12-24T21:55:42.393 INFO:teuthology.orchestra.run.smithi037.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-12-24T21:55:42.393 INFO:teuthology.orchestra.run.smithi037.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-12-24T21:55:42.393 INFO:teuthology.orchestra.run.smithi037.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-12-24T21:55:42.393 INFO:teuthology.orchestra.run.smithi037.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-12-24T21:55:42.395 INFO:teuthology.orchestra.run.smithi037.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-12-24T21:55:42.395 INFO:teuthology.orchestra.run.smithi037.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-12-24T21:55:42.396 INFO:teuthology.orchestra.run.smithi037.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-12-24T21:55:42.396 INFO:teuthology.orchestra.run.smithi037.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-12-24T21:55:42.396 INFO:teuthology.orchestra.run.smithi037.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-12-24T21:55:42.396 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:42.396 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2019-12-24T21:55:42.530 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-base 2019-12-24T21:55:42.687 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 15/20 2019-12-24T21:55:42.814 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:55:42.859 INFO:teuthology.orchestra.run.smithi037.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:55:42.860 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:55:42.861 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:55:42.861 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:55:42.861 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:55:42.917 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 19/20 2019-12-24T21:55:43.063 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python-mako-0.8.1-2.el7.noarch 16/20 2019-12-24T21:55:43.198 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:ceph-14.2.5-54.gfd2fdc3.el7.x86_64 20/20 2019-12-24T21:55:43.332 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 1/20 2019-12-24T21:55:43.483 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 2/20 2019-12-24T21:55:43.537 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:55:43.553 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 17/20 2019-12-24T21:55:43.600 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 3/20 2019-12-24T21:55:43.675 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 4/20 2019-12-24T21:55:43.759 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 5/20 2019-12-24T21:55:43.851 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 6/20 2019-12-24T21:55:43.888 INFO:teuthology.orchestra.run.smithi037.stdout:Package 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:55:43.888 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do 2019-12-24T21:55:43.950 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr 2019-12-24T21:55:43.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 7/20 2019-12-24T21:55:44.060 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 8/20 2019-12-24T21:55:44.161 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 9/20 2019-12-24T21:55:44.207 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:55:44.254 INFO:teuthology.orchestra.run.smithi037.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:55:44.255 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:55:44.255 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:55:44.255 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:55:44.256 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:55:44.261 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 10/20 2019-12-24T21:55:44.378 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:ceph-osd-14.2.5-54.gfd2fdc3.el7.x86_64 11/20 2019-12-24T21:55:44.429 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 18/20 2019-12-24T21:55:44.529 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 12/20 2019-12-24T21:55:44.679 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 13/20 2019-12-24T21:55:44.788 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 14/20 2019-12-24T21:55:44.889 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:ceph-14.2.5-54.gfd2fdc3.el7.x86_64 15/20 2019-12-24T21:55:44.932 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 19/20 2019-12-24T21:55:44.948 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:55:44.998 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:ceph-mds-14.2.5-54.gfd2fdc3.el7.x86_64 16/20 2019-12-24T21:55:45.148 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 17/20 2019-12-24T21:55:45.260 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:ceph-14.2.5-54.gfd2fdc3.el7.x86_64 20/20 2019-12-24T21:55:45.273 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 18/20 2019-12-24T21:55:45.298 INFO:teuthology.orchestra.run.smithi037.stdout:Package 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:55:45.298 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do 2019-12-24T21:55:45.359 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-dashboard 2019-12-24T21:55:45.391 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 19/20 2019-12-24T21:55:45.422 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 1/20 2019-12-24T21:55:45.547 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 2/20 2019-12-24T21:55:45.592 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:55:45.636 INFO:teuthology.orchestra.run.smithi037.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:55:45.637 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:55:45.638 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:55:45.638 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:55:45.638 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:55:45.708 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 3/20 2019-12-24T21:55:45.798 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 4/20 2019-12-24T21:55:45.803 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:ceph-mon-14.2.5-54.gfd2fdc3.el7.x86_64 20/20 2019-12-24T21:55:45.803 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:45.803 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2019-12-24T21:55:45.803 INFO:teuthology.orchestra.run.smithi006.stdout: ceph.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:45.804 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:45.804 INFO:teuthology.orchestra.run.smithi006.stdout:Dependency Installed: 2019-12-24T21:55:45.804 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:45.804 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:45.804 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:45.804 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:45.804 INFO:teuthology.orchestra.run.smithi006.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-12-24T21:55:45.805 INFO:teuthology.orchestra.run.smithi006.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-12-24T21:55:45.805 INFO:teuthology.orchestra.run.smithi006.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-12-24T21:55:45.805 INFO:teuthology.orchestra.run.smithi006.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-12-24T21:55:45.805 INFO:teuthology.orchestra.run.smithi006.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-12-24T21:55:45.805 INFO:teuthology.orchestra.run.smithi006.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-12-24T21:55:45.805 INFO:teuthology.orchestra.run.smithi006.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-12-24T21:55:45.805 INFO:teuthology.orchestra.run.smithi006.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-12-24T21:55:45.806 INFO:teuthology.orchestra.run.smithi006.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-12-24T21:55:45.806 INFO:teuthology.orchestra.run.smithi006.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-12-24T21:55:45.806 INFO:teuthology.orchestra.run.smithi006.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-12-24T21:55:45.806 INFO:teuthology.orchestra.run.smithi006.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-12-24T21:55:45.806 INFO:teuthology.orchestra.run.smithi006.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-12-24T21:55:45.806 INFO:teuthology.orchestra.run.smithi006.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-12-24T21:55:45.806 INFO:teuthology.orchestra.run.smithi006.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-12-24T21:55:45.807 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:45.807 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2019-12-24T21:55:45.890 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 5/20 2019-12-24T21:55:45.936 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-base 2019-12-24T21:55:46.015 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 6/20 2019-12-24T21:55:46.108 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 7/20 2019-12-24T21:55:46.180 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:55:46.200 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 8/20 2019-12-24T21:55:46.220 INFO:teuthology.orchestra.run.smithi006.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:55:46.221 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:55:46.221 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:55:46.222 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:55:46.222 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:55:46.271 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:55:46.325 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 9/20 2019-12-24T21:55:46.401 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 10/20 2019-12-24T21:55:46.568 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:ceph-osd-14.2.5-54.gfd2fdc3.el7.x86_64 11/20 2019-12-24T21:55:46.614 INFO:teuthology.orchestra.run.smithi037.stdout:Resolving Dependencies 2019-12-24T21:55:46.614 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:55:46.615 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package ceph-mgr-dashboard.noarch 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:46.617 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-mgr-dashboard-14.2.5-54.gfd2fdc3.el7.noarch 2019-12-24T21:55:46.648 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-14.2.5-54.gfd2fdc3.el7.noarch 2019-12-24T21:55:46.649 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:55:46.650 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package ceph-grafana-dashboards.noarch 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:46.650 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-12-24T21:55:46.650 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-12-24T21:55:46.651 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:55:46.651 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-12-24T21:55:46.689 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 12/20 2019-12-24T21:55:46.878 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 13/20 2019-12-24T21:55:46.891 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:55:46.995 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 14/20 2019-12-24T21:55:47.039 INFO:teuthology.orchestra.run.smithi037.stdout:--> Finished Dependency Resolution 2019-12-24T21:55:47.129 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:ceph-14.2.5-54.gfd2fdc3.el7.x86_64 15/20 2019-12-24T21:55:47.235 INFO:teuthology.orchestra.run.smithi006.stdout:Package 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:55:47.235 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do 2019-12-24T21:55:47.254 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:ceph-mds-14.2.5-54.gfd2fdc3.el7.x86_64 16/20 2019-12-24T21:55:47.270 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:47.271 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies Resolved 2019-12-24T21:55:47.272 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:47.272 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:55:47.272 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2019-12-24T21:55:47.272 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:55:47.272 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2019-12-24T21:55:47.272 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:14.2.5-54.gfd2fdc3.el7 ceph-noarch 3.7 M 2019-12-24T21:55:47.273 INFO:teuthology.orchestra.run.smithi037.stdout:Installing for dependencies: 2019-12-24T21:55:47.273 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:14.2.5-54.gfd2fdc3.el7 ceph-noarch 18 k 2019-12-24T21:55:47.273 INFO:teuthology.orchestra.run.smithi037.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-12-24T21:55:47.273 INFO:teuthology.orchestra.run.smithi037.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-12-24T21:55:47.273 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:47.273 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2019-12-24T21:55:47.273 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:55:47.274 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package (+3 Dependent packages) 2019-12-24T21:55:47.274 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:47.274 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 4.3 M 2019-12-24T21:55:47.274 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 19 M 2019-12-24T21:55:47.274 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading packages: 2019-12-24T21:55:47.297 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-mgr 2019-12-24T21:55:47.398 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 17/20 2019-12-24T21:55:47.453 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:55:47.490 INFO:teuthology.orchestra.run.smithi006.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:55:47.491 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:55:47.491 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:55:47.491 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:55:47.492 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:55:47.530 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 18/20 2019-12-24T21:55:47.647 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 19/20 2019-12-24T21:55:47.829 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2019-12-24T21:55:47.829 INFO:teuthology.orchestra.run.smithi037.stdout:Total 7.8 MB/s | 4.3 MB 00:00 2019-12-24T21:55:47.835 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2019-12-24T21:55:47.841 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2019-12-24T21:55:47.972 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded 2019-12-24T21:55:47.972 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2019-12-24T21:55:48.114 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:55:48.117 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:ceph-mon-14.2.5-54.gfd2fdc3.el7.x86_64 20/20 2019-12-24T21:55:48.117 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:48.117 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2019-12-24T21:55:48.117 INFO:teuthology.orchestra.run.smithi124.stdout: ceph.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:48.117 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:48.117 INFO:teuthology.orchestra.run.smithi124.stdout:Dependency Installed: 2019-12-24T21:55:48.117 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mds.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:48.118 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:48.118 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mon.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:48.118 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-osd.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:48.118 INFO:teuthology.orchestra.run.smithi124.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-12-24T21:55:48.118 INFO:teuthology.orchestra.run.smithi124.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-12-24T21:55:48.118 INFO:teuthology.orchestra.run.smithi124.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-12-24T21:55:48.118 INFO:teuthology.orchestra.run.smithi124.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-12-24T21:55:48.119 INFO:teuthology.orchestra.run.smithi124.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-12-24T21:55:48.119 INFO:teuthology.orchestra.run.smithi124.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-12-24T21:55:48.119 INFO:teuthology.orchestra.run.smithi124.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-12-24T21:55:48.119 INFO:teuthology.orchestra.run.smithi124.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-12-24T21:55:48.119 INFO:teuthology.orchestra.run.smithi124.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-12-24T21:55:48.119 INFO:teuthology.orchestra.run.smithi124.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-12-24T21:55:48.119 INFO:teuthology.orchestra.run.smithi124.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-12-24T21:55:48.119 INFO:teuthology.orchestra.run.smithi124.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-12-24T21:55:48.120 INFO:teuthology.orchestra.run.smithi124.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-12-24T21:55:48.120 INFO:teuthology.orchestra.run.smithi124.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-12-24T21:55:48.120 INFO:teuthology.orchestra.run.smithi124.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-12-24T21:55:48.120 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:48.120 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2019-12-24T21:55:48.247 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-base 2019-12-24T21:55:48.456 INFO:teuthology.orchestra.run.smithi006.stdout:Package 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:55:48.456 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do 2019-12-24T21:55:48.518 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-mgr-dashboard 2019-12-24T21:55:48.528 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:55:48.573 INFO:teuthology.orchestra.run.smithi124.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:55:48.574 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:55:48.575 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:55:48.575 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:55:48.575 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:55:48.660 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:ceph-grafana-dashboards-14.2.5-54.gfd2fdc3.el7.noarch 1/4 2019-12-24T21:55:48.764 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:55:48.810 INFO:teuthology.orchestra.run.smithi006.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:55:48.811 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:55:48.812 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:55:48.812 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:55:48.812 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:55:49.087 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-12-24T21:55:49.222 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:55:49.478 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:55:49.558 INFO:teuthology.orchestra.run.smithi124.stdout:Package 2:ceph-base-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:55:49.559 INFO:teuthology.orchestra.run.smithi124.stdout:Nothing to do 2019-12-24T21:55:49.620 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-mgr 2019-12-24T21:55:49.830 INFO:teuthology.orchestra.run.smithi006.stdout:Resolving Dependencies 2019-12-24T21:55:49.831 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:55:49.831 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package ceph-mgr-dashboard.noarch 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:49.834 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-mgr-dashboard-14.2.5-54.gfd2fdc3.el7.noarch 2019-12-24T21:55:49.864 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-14.2.5-54.gfd2fdc3.el7.noarch 2019-12-24T21:55:49.865 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:55:49.866 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package ceph-grafana-dashboards.noarch 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:49.866 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-12-24T21:55:49.866 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-12-24T21:55:49.868 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:55:49.868 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-12-24T21:55:49.871 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:55:49.916 INFO:teuthology.orchestra.run.smithi124.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:55:49.917 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:55:49.917 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:55:49.918 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:55:49.918 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:55:50.255 INFO:teuthology.orchestra.run.smithi006.stdout:--> Finished Dependency Resolution 2019-12-24T21:55:50.411 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-12-24T21:55:50.487 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:50.487 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies Resolved 2019-12-24T21:55:50.489 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:50.489 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:55:50.489 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2019-12-24T21:55:50.489 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:55:50.490 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2019-12-24T21:55:50.490 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard noarch 2:14.2.5-54.gfd2fdc3.el7 ceph-noarch 3.7 M 2019-12-24T21:55:50.490 INFO:teuthology.orchestra.run.smithi006.stdout:Installing for dependencies: 2019-12-24T21:55:50.490 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards noarch 2:14.2.5-54.gfd2fdc3.el7 ceph-noarch 18 k 2019-12-24T21:55:50.490 INFO:teuthology.orchestra.run.smithi006.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-12-24T21:55:50.490 INFO:teuthology.orchestra.run.smithi006.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-12-24T21:55:50.490 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:50.491 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2019-12-24T21:55:50.491 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:55:50.491 INFO:teuthology.orchestra.run.smithi006.stdout:Install 1 Package (+3 Dependent packages) 2019-12-24T21:55:50.491 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:50.491 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 4.3 M 2019-12-24T21:55:50.491 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 19 M 2019-12-24T21:55:50.491 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading packages: 2019-12-24T21:55:50.573 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:55:50.775 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:ceph-mgr-dashboard-14.2.5-54.gfd2fdc3.el7.noarch 4/4 2019-12-24T21:55:50.868 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-12-24T21:55:50.907 INFO:teuthology.orchestra.run.smithi124.stdout:Package 2:ceph-mgr-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:55:50.907 INFO:teuthology.orchestra.run.smithi124.stdout:Nothing to do 2019-12-24T21:55:50.967 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-mgr-dashboard 2019-12-24T21:55:50.993 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:ceph-mgr-dashboard-14.2.5-54.gfd2fdc3.el7.noarch 2/4 2019-12-24T21:55:51.085 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:ceph-grafana-dashboards-14.2.5-54.gfd2fdc3.el7.noarch 3/4 2019-12-24T21:55:51.117 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2019-12-24T21:55:51.117 INFO:teuthology.orchestra.run.smithi006.stdout:Total 6.9 MB/s | 4.3 MB 00:00 2019-12-24T21:55:51.123 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2019-12-24T21:55:51.132 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2019-12-24T21:55:51.207 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:55:51.252 INFO:teuthology.orchestra.run.smithi124.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:55:51.253 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:55:51.254 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:55:51.254 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:55:51.254 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:55:51.278 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded 2019-12-24T21:55:51.279 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2019-12-24T21:55:51.511 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-12-24T21:55:51.511 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:51.511 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2019-12-24T21:55:51.512 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard.noarch 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:51.512 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:51.512 INFO:teuthology.orchestra.run.smithi037.stdout:Dependency Installed: 2019-12-24T21:55:51.512 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards.noarch 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:51.512 INFO:teuthology.orchestra.run.smithi037.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-12-24T21:55:51.512 INFO:teuthology.orchestra.run.smithi037.stdout: python-routes.noarch 0:1.13-2.el7 2019-12-24T21:55:51.512 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:51.513 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2019-12-24T21:55:51.629 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-diskprediction-local 2019-12-24T21:55:51.840 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:55:51.879 INFO:teuthology.orchestra.run.smithi037.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:55:51.880 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:55:51.880 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:55:51.881 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:55:51.881 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:55:51.906 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:55:51.913 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:ceph-grafana-dashboards-14.2.5-54.gfd2fdc3.el7.noarch 1/4 2019-12-24T21:55:52.241 INFO:teuthology.orchestra.run.smithi124.stdout:Resolving Dependencies 2019-12-24T21:55:52.242 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:55:52.242 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package ceph-mgr-dashboard.noarch 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:52.245 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:14.2.5-54.gfd2fdc3.el7 for package: 2:ceph-mgr-dashboard-14.2.5-54.gfd2fdc3.el7.noarch 2019-12-24T21:55:52.274 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-14.2.5-54.gfd2fdc3.el7.noarch 2019-12-24T21:55:52.275 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:55:52.276 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package ceph-grafana-dashboards.noarch 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:52.276 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-12-24T21:55:52.276 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-12-24T21:55:52.277 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:55:52.277 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-12-24T21:55:52.380 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-12-24T21:55:52.544 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:55:52.644 INFO:teuthology.orchestra.run.smithi124.stdout:--> Finished Dependency Resolution 2019-12-24T21:55:52.864 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:52.865 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies Resolved 2019-12-24T21:55:52.865 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:52.866 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:55:52.866 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2019-12-24T21:55:52.866 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:55:52.866 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2019-12-24T21:55:52.866 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-dashboard noarch 2:14.2.5-54.gfd2fdc3.el7 ceph-noarch 3.7 M 2019-12-24T21:55:52.866 INFO:teuthology.orchestra.run.smithi124.stdout:Installing for dependencies: 2019-12-24T21:55:52.867 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-grafana-dashboards noarch 2:14.2.5-54.gfd2fdc3.el7 ceph-noarch 18 k 2019-12-24T21:55:52.867 INFO:teuthology.orchestra.run.smithi124.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-12-24T21:55:52.867 INFO:teuthology.orchestra.run.smithi124.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-12-24T21:55:52.867 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:52.867 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2019-12-24T21:55:52.867 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:55:52.868 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package (+3 Dependent packages) 2019-12-24T21:55:52.868 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:52.868 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 4.3 M 2019-12-24T21:55:52.868 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 19 M 2019-12-24T21:55:52.868 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading packages: 2019-12-24T21:55:52.888 INFO:teuthology.orchestra.run.smithi037.stdout:Resolving Dependencies 2019-12-24T21:55:52.888 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:55:52.889 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:52.889 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-14.2.5-54.gfd2fdc3.el7.noarch 2019-12-24T21:55:52.919 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:55:52.920 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-12-24T21:55:52.927 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-12-24T21:55:52.928 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-24T21:55:52.930 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-24T21:55:52.930 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:55:52.930 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-12-24T21:55:52.931 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-12-24T21:55:52.932 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-24T21:55:52.934 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-24T21:55:52.934 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:55:52.934 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-12-24T21:55:53.320 INFO:teuthology.orchestra.run.smithi037.stdout:--> Finished Dependency Resolution 2019-12-24T21:55:53.420 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2019-12-24T21:55:53.421 INFO:teuthology.orchestra.run.smithi124.stdout:Total 7.8 MB/s | 4.3 MB 00:00 2019-12-24T21:55:53.424 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2019-12-24T21:55:53.430 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2019-12-24T21:55:53.509 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-12-24T21:55:53.553 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:53.553 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies Resolved 2019-12-24T21:55:53.554 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:53.554 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:55:53.554 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2019-12-24T21:55:53.554 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:55:53.555 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2019-12-24T21:55:53.555 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local 2019-12-24T21:55:53.555 INFO:teuthology.orchestra.run.smithi037.stdout: noarch 2:14.2.5-54.gfd2fdc3.el7 ceph-noarch 1.1 M 2019-12-24T21:55:53.555 INFO:teuthology.orchestra.run.smithi037.stdout:Installing for dependencies: 2019-12-24T21:55:53.555 INFO:teuthology.orchestra.run.smithi037.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-12-24T21:55:53.555 INFO:teuthology.orchestra.run.smithi037.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-12-24T21:55:53.555 INFO:teuthology.orchestra.run.smithi037.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-12-24T21:55:53.556 INFO:teuthology.orchestra.run.smithi037.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-12-24T21:55:53.556 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:53.556 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2019-12-24T21:55:53.556 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:55:53.556 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package (+4 Dependent packages) 2019-12-24T21:55:53.556 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:55:53.557 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 12 M 2019-12-24T21:55:53.557 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 66 M 2019-12-24T21:55:53.557 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading packages: 2019-12-24T21:55:53.587 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded 2019-12-24T21:55:53.588 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2019-12-24T21:55:53.916 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:ceph-mgr-dashboard-14.2.5-54.gfd2fdc3.el7.noarch 4/4 2019-12-24T21:55:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-12-24T21:55:54.066 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2019-12-24T21:55:54.066 INFO:teuthology.orchestra.run.smithi037.stdout:Total 23 MB/s | 12 MB 00:00 2019-12-24T21:55:54.076 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2019-12-24T21:55:54.101 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2019-12-24T21:55:54.108 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:ceph-mgr-dashboard-14.2.5-54.gfd2fdc3.el7.noarch 2/4 2019-12-24T21:55:54.233 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:ceph-grafana-dashboards-14.2.5-54.gfd2fdc3.el7.noarch 3/4 2019-12-24T21:55:54.286 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:ceph-grafana-dashboards-14.2.5-54.gfd2fdc3.el7.noarch 1/4 2019-12-24T21:55:54.588 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded 2019-12-24T21:55:54.589 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2019-12-24T21:55:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-12-24T21:55:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:54.678 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2019-12-24T21:55:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard.noarch 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:54.678 INFO:teuthology.orchestra.run.smithi006.stdout:Dependency Installed: 2019-12-24T21:55:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards.noarch 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-12-24T21:55:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: python-routes.noarch 0:1.13-2.el7 2019-12-24T21:55:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:54.679 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2019-12-24T21:55:54.785 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-12-24T21:55:54.813 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-mgr-diskprediction-local 2019-12-24T21:55:55.017 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:55:55.058 INFO:teuthology.orchestra.run.smithi006.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:55:55.059 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:55:55.060 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:55:55.060 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:55:55.060 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:55:55.728 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:55:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 1/5 2019-12-24T21:55:55.955 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-12-24T21:55:56.071 INFO:teuthology.orchestra.run.smithi006.stdout:Resolving Dependencies 2019-12-24T21:55:56.071 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:55:56.071 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:56.074 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-14.2.5-54.gfd2fdc3.el7.noarch 2019-12-24T21:55:56.105 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:55:56.105 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-12-24T21:55:56.112 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-12-24T21:55:56.114 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-24T21:55:56.116 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-24T21:55:56.116 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:55:56.116 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-12-24T21:55:56.117 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-12-24T21:55:56.118 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-24T21:55:56.120 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-24T21:55:56.120 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:55:56.120 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-12-24T21:55:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-12-24T21:55:56.411 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:ceph-mgr-dashboard-14.2.5-54.gfd2fdc3.el7.noarch 4/4 2019-12-24T21:55:56.504 INFO:teuthology.orchestra.run.smithi006.stdout:--> Finished Dependency Resolution 2019-12-24T21:55:56.545 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-12-24T21:55:56.696 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:ceph-mgr-dashboard-14.2.5-54.gfd2fdc3.el7.noarch 2/4 2019-12-24T21:55:56.734 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:56.734 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies Resolved 2019-12-24T21:55:56.735 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:56.736 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:55:56.736 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2019-12-24T21:55:56.736 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:55:56.736 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2019-12-24T21:55:56.737 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local 2019-12-24T21:55:56.737 INFO:teuthology.orchestra.run.smithi006.stdout: noarch 2:14.2.5-54.gfd2fdc3.el7 ceph-noarch 1.1 M 2019-12-24T21:55:56.737 INFO:teuthology.orchestra.run.smithi006.stdout:Installing for dependencies: 2019-12-24T21:55:56.737 INFO:teuthology.orchestra.run.smithi006.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-12-24T21:55:56.738 INFO:teuthology.orchestra.run.smithi006.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-12-24T21:55:56.738 INFO:teuthology.orchestra.run.smithi006.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-12-24T21:55:56.738 INFO:teuthology.orchestra.run.smithi006.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-12-24T21:55:56.738 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:56.739 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2019-12-24T21:55:56.739 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:55:56.739 INFO:teuthology.orchestra.run.smithi006.stdout:Install 1 Package (+4 Dependent packages) 2019-12-24T21:55:56.739 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:55:56.740 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 12 M 2019-12-24T21:55:56.740 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 66 M 2019-12-24T21:55:56.740 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading packages: 2019-12-24T21:55:56.838 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:ceph-grafana-dashboards-14.2.5-54.gfd2fdc3.el7.noarch 3/4 2019-12-24T21:55:57.281 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-12-24T21:55:57.282 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:57.282 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2019-12-24T21:55:57.282 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-dashboard.noarch 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:57.282 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:57.282 INFO:teuthology.orchestra.run.smithi124.stdout:Dependency Installed: 2019-12-24T21:55:57.282 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-grafana-dashboards.noarch 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:55:57.282 INFO:teuthology.orchestra.run.smithi124.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-12-24T21:55:57.283 INFO:teuthology.orchestra.run.smithi124.stdout: python-routes.noarch 0:1.13-2.el7 2019-12-24T21:55:57.283 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:57.283 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2019-12-24T21:55:57.411 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-mgr-diskprediction-local 2019-12-24T21:55:57.508 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2019-12-24T21:55:57.508 INFO:teuthology.orchestra.run.smithi006.stdout:Total 15 MB/s | 12 MB 00:00 2019-12-24T21:55:57.525 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2019-12-24T21:55:57.563 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2019-12-24T21:55:57.681 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:55:57.726 INFO:teuthology.orchestra.run.smithi124.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:55:57.727 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:55:57.727 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:55:57.727 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:55:57.728 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:55:58.066 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-12-24T21:55:58.272 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded 2019-12-24T21:55:58.273 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2019-12-24T21:55:58.378 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:55:58.714 INFO:teuthology.orchestra.run.smithi124.stdout:Resolving Dependencies 2019-12-24T21:55:58.715 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:55:58.715 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:55:58.717 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-14.2.5-54.gfd2fdc3.el7.noarch 2019-12-24T21:55:58.747 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:55:58.747 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-12-24T21:55:58.754 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-12-24T21:55:58.755 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-24T21:55:58.757 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-24T21:55:58.757 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:55:58.758 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-12-24T21:55:58.758 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-12-24T21:55:58.759 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-24T21:55:58.761 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-24T21:55:58.761 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:55:58.761 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-12-24T21:55:58.872 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-12-24T21:55:59.220 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:ceph-mgr-diskprediction-local-14.2.5-54.gfd2fdc3.el7.noa 5/5 2019-12-24T21:55:59.294 INFO:teuthology.orchestra.run.smithi124.stdout:--> Finished Dependency Resolution 2019-12-24T21:55:59.309 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-12-24T21:55:59.451 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:ceph-mgr-diskprediction-local-14.2.5-54.gfd2fdc3.el7.noa 2/5 2019-12-24T21:55:59.543 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-12-24T21:55:59.553 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:59.553 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies Resolved 2019-12-24T21:55:59.554 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:59.554 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:55:59.554 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2019-12-24T21:55:59.554 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:55:59.555 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2019-12-24T21:55:59.555 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-diskprediction-local 2019-12-24T21:55:59.555 INFO:teuthology.orchestra.run.smithi124.stdout: noarch 2:14.2.5-54.gfd2fdc3.el7 ceph-noarch 1.1 M 2019-12-24T21:55:59.555 INFO:teuthology.orchestra.run.smithi124.stdout:Installing for dependencies: 2019-12-24T21:55:59.555 INFO:teuthology.orchestra.run.smithi124.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-12-24T21:55:59.555 INFO:teuthology.orchestra.run.smithi124.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-12-24T21:55:59.555 INFO:teuthology.orchestra.run.smithi124.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-12-24T21:55:59.556 INFO:teuthology.orchestra.run.smithi124.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-12-24T21:55:59.556 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:59.556 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2019-12-24T21:55:59.556 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:55:59.556 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package (+4 Dependent packages) 2019-12-24T21:55:59.556 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:55:59.557 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 12 M 2019-12-24T21:55:59.557 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 66 M 2019-12-24T21:55:59.557 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading packages: 2019-12-24T21:55:59.564 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 1/5 2019-12-24T21:55:59.644 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 4/5 2019-12-24T21:55:59.987 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-12-24T21:56:00.064 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2019-12-24T21:56:00.065 INFO:teuthology.orchestra.run.smithi124.stdout:Total 23 MB/s | 12 MB 00:00 2019-12-24T21:56:00.076 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2019-12-24T21:56:00.104 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2019-12-24T21:56:00.121 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 5/5 2019-12-24T21:56:00.121 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:00.121 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2019-12-24T21:56:00.121 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local.noarch 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:00.121 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:00.122 INFO:teuthology.orchestra.run.smithi037.stdout:Dependency Installed: 2019-12-24T21:56:00.122 INFO:teuthology.orchestra.run.smithi037.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-12-24T21:56:00.122 INFO:teuthology.orchestra.run.smithi037.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-12-24T21:56:00.122 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:00.122 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2019-12-24T21:56:00.248 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-rook 2019-12-24T21:56:00.249 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded 2019-12-24T21:56:00.249 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2019-12-24T21:56:00.495 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:00.541 INFO:teuthology.orchestra.run.smithi037.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:00.542 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:56:00.542 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:00.543 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:00.543 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:01.150 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 1/5 2019-12-24T21:56:01.211 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:01.565 INFO:teuthology.orchestra.run.smithi037.stdout:Resolving Dependencies 2019-12-24T21:56:01.566 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:56:01.566 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package ceph-mgr-rook.noarch 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:01.567 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-14.2.5-54.gfd2fdc3.el7.noarch 2019-12-24T21:56:01.599 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:56:01.599 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-12-24T21:56:01.601 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-24T21:56:01.602 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-24T21:56:01.603 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-24T21:56:01.604 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-24T21:56:01.606 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:56:01.606 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-12-24T21:56:01.606 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-12-24T21:56:01.606 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-12-24T21:56:01.607 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-24T21:56:01.608 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-24T21:56:01.609 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-24T21:56:01.610 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-12-24T21:56:01.610 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-12-24T21:56:01.611 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:56:01.611 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-12-24T21:56:01.612 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-12-24T21:56:01.612 INFO:teuthology.orchestra.run.smithi037.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-12-24T21:56:01.613 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-12-24T21:56:01.613 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-12-24T21:56:01.613 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:56:01.613 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-12-24T21:56:01.665 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-12-24T21:56:01.755 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-12-24T21:56:02.002 INFO:teuthology.orchestra.run.smithi037.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:02.237 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:02.237 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies Resolved 2019-12-24T21:56:02.239 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:02.239 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:02.239 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2019-12-24T21:56:02.239 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:02.239 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2019-12-24T21:56:02.240 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:14.2.5-54.gfd2fdc3.el7 ceph-noarch 20 k 2019-12-24T21:56:02.240 INFO:teuthology.orchestra.run.smithi037.stdout:Installing for dependencies: 2019-12-24T21:56:02.240 INFO:teuthology.orchestra.run.smithi037.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-12-24T21:56:02.240 INFO:teuthology.orchestra.run.smithi037.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-12-24T21:56:02.240 INFO:teuthology.orchestra.run.smithi037.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-12-24T21:56:02.240 INFO:teuthology.orchestra.run.smithi037.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-12-24T21:56:02.240 INFO:teuthology.orchestra.run.smithi037.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-12-24T21:56:02.241 INFO:teuthology.orchestra.run.smithi037.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-12-24T21:56:02.241 INFO:teuthology.orchestra.run.smithi037.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-12-24T21:56:02.241 INFO:teuthology.orchestra.run.smithi037.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-12-24T21:56:02.241 INFO:teuthology.orchestra.run.smithi037.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-12-24T21:56:02.241 INFO:teuthology.orchestra.run.smithi037.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-12-24T21:56:02.241 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:02.241 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2019-12-24T21:56:02.242 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:02.242 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package (+10 Dependent packages) 2019-12-24T21:56:02.242 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:02.242 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 1.6 M 2019-12-24T21:56:02.243 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 24 M 2019-12-24T21:56:02.243 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading packages: 2019-12-24T21:56:02.585 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-12-24T21:56:02.918 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:ceph-mgr-diskprediction-local-14.2.5-54.gfd2fdc3.el7.noa 5/5 2019-12-24T21:56:02.970 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2019-12-24T21:56:02.971 INFO:teuthology.orchestra.run.smithi037.stdout:Total 2.3 MB/s | 1.6 MB 00:00 2019-12-24T21:56:02.987 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2019-12-24T21:56:03.001 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2019-12-24T21:56:03.041 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-12-24T21:56:03.077 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded 2019-12-24T21:56:03.077 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2019-12-24T21:56:03.125 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:ceph-mgr-diskprediction-local-14.2.5-54.gfd2fdc3.el7.noa 2/5 2019-12-24T21:56:03.209 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-12-24T21:56:03.326 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 4/5 2019-12-24T21:56:03.446 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-12-24T21:56:03.757 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-12-24T21:56:03.811 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 5/5 2019-12-24T21:56:03.811 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:03.812 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2019-12-24T21:56:03.812 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local.noarch 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:03.812 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:03.812 INFO:teuthology.orchestra.run.smithi006.stdout:Dependency Installed: 2019-12-24T21:56:03.812 INFO:teuthology.orchestra.run.smithi006.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-12-24T21:56:03.812 INFO:teuthology.orchestra.run.smithi006.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-12-24T21:56:03.812 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:03.813 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2019-12-24T21:56:03.948 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-mgr-rook 2019-12-24T21:56:04.072 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 2/11 2019-12-24T21:56:04.209 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:04.255 INFO:teuthology.orchestra.run.smithi006.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:04.256 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:56:04.257 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:04.257 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:04.257 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:04.312 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-12-24T21:56:04.406 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 3/11 2019-12-24T21:56:04.696 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:ceph-mgr-diskprediction-local-14.2.5-54.gfd2fdc3.el7.noa 5/5 2019-12-24T21:56:04.845 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-12-24T21:56:04.929 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:ceph-mgr-diskprediction-local-14.2.5-54.gfd2fdc3.el7.noa 2/5 2019-12-24T21:56:04.935 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:05.021 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-12-24T21:56:05.155 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 4/5 2019-12-24T21:56:05.266 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 4/11 2019-12-24T21:56:05.285 INFO:teuthology.orchestra.run.smithi006.stdout:Resolving Dependencies 2019-12-24T21:56:05.286 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:56:05.286 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package ceph-mgr-rook.noarch 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:05.288 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-14.2.5-54.gfd2fdc3.el7.noarch 2019-12-24T21:56:05.319 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:56:05.319 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-12-24T21:56:05.322 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-24T21:56:05.323 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-24T21:56:05.324 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-24T21:56:05.325 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-24T21:56:05.326 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:56:05.326 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-12-24T21:56:05.327 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-12-24T21:56:05.327 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-12-24T21:56:05.327 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-24T21:56:05.328 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-24T21:56:05.329 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-24T21:56:05.330 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-12-24T21:56:05.331 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-12-24T21:56:05.332 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:56:05.332 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-12-24T21:56:05.332 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-12-24T21:56:05.332 INFO:teuthology.orchestra.run.smithi006.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-12-24T21:56:05.333 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-12-24T21:56:05.333 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-12-24T21:56:05.334 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:56:05.334 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-12-24T21:56:05.565 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 5/5 2019-12-24T21:56:05.565 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:05.566 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2019-12-24T21:56:05.566 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-diskprediction-local.noarch 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:05.566 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:05.566 INFO:teuthology.orchestra.run.smithi124.stdout:Dependency Installed: 2019-12-24T21:56:05.566 INFO:teuthology.orchestra.run.smithi124.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-12-24T21:56:05.566 INFO:teuthology.orchestra.run.smithi124.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-12-24T21:56:05.566 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:05.567 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2019-12-24T21:56:05.577 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 5/11 2019-12-24T21:56:05.695 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-mgr-rook 2019-12-24T21:56:05.721 INFO:teuthology.orchestra.run.smithi006.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:05.901 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 6/11 2019-12-24T21:56:05.907 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:05.948 INFO:teuthology.orchestra.run.smithi124.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:05.949 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:56:05.950 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:05.950 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:05.951 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:05.955 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:06.005 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies Resolved 2019-12-24T21:56:06.006 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:06.006 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:06.006 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2019-12-24T21:56:06.006 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:06.006 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2019-12-24T21:56:06.006 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook noarch 2:14.2.5-54.gfd2fdc3.el7 ceph-noarch 20 k 2019-12-24T21:56:06.007 INFO:teuthology.orchestra.run.smithi006.stdout:Installing for dependencies: 2019-12-24T21:56:06.007 INFO:teuthology.orchestra.run.smithi006.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-12-24T21:56:06.007 INFO:teuthology.orchestra.run.smithi006.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-12-24T21:56:06.007 INFO:teuthology.orchestra.run.smithi006.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-12-24T21:56:06.007 INFO:teuthology.orchestra.run.smithi006.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-12-24T21:56:06.007 INFO:teuthology.orchestra.run.smithi006.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-12-24T21:56:06.007 INFO:teuthology.orchestra.run.smithi006.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-12-24T21:56:06.008 INFO:teuthology.orchestra.run.smithi006.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-12-24T21:56:06.008 INFO:teuthology.orchestra.run.smithi006.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-12-24T21:56:06.008 INFO:teuthology.orchestra.run.smithi006.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-12-24T21:56:06.008 INFO:teuthology.orchestra.run.smithi006.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-12-24T21:56:06.008 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:06.008 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2019-12-24T21:56:06.008 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:06.008 INFO:teuthology.orchestra.run.smithi006.stdout:Install 1 Package (+10 Dependent packages) 2019-12-24T21:56:06.009 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:06.009 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 1.6 M 2019-12-24T21:56:06.009 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 24 M 2019-12-24T21:56:06.009 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading packages: 2019-12-24T21:56:06.322 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 7/11 2019-12-24T21:56:06.600 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:06.681 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2019-12-24T21:56:06.681 INFO:teuthology.orchestra.run.smithi006.stdout:Total 2.3 MB/s | 1.6 MB 00:00 2019-12-24T21:56:06.695 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2019-12-24T21:56:06.706 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 8/11 2019-12-24T21:56:06.706 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2019-12-24T21:56:06.771 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded 2019-12-24T21:56:06.772 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2019-12-24T21:56:06.927 INFO:teuthology.orchestra.run.smithi124.stdout:Resolving Dependencies 2019-12-24T21:56:06.928 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:56:06.928 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package ceph-mgr-rook.noarch 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:06.930 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-14.2.5-54.gfd2fdc3.el7.noarch 2019-12-24T21:56:06.959 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:56:06.960 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-12-24T21:56:06.962 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-24T21:56:06.963 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-24T21:56:06.964 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-24T21:56:06.965 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-24T21:56:06.966 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:56:06.966 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-12-24T21:56:06.967 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-12-24T21:56:06.967 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-12-24T21:56:06.967 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-24T21:56:06.968 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-24T21:56:06.969 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-24T21:56:06.970 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-12-24T21:56:06.970 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-12-24T21:56:06.971 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:56:06.971 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-12-24T21:56:06.972 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-12-24T21:56:06.972 INFO:teuthology.orchestra.run.smithi124.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-12-24T21:56:06.973 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-12-24T21:56:06.973 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-12-24T21:56:06.974 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:56:06.974 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-12-24T21:56:07.344 INFO:teuthology.orchestra.run.smithi124.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:07.480 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-12-24T21:56:07.570 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:07.570 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies Resolved 2019-12-24T21:56:07.571 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:07.572 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:07.572 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2019-12-24T21:56:07.572 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:07.572 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2019-12-24T21:56:07.572 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-rook noarch 2:14.2.5-54.gfd2fdc3.el7 ceph-noarch 20 k 2019-12-24T21:56:07.572 INFO:teuthology.orchestra.run.smithi124.stdout:Installing for dependencies: 2019-12-24T21:56:07.573 INFO:teuthology.orchestra.run.smithi124.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-12-24T21:56:07.573 INFO:teuthology.orchestra.run.smithi124.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-12-24T21:56:07.573 INFO:teuthology.orchestra.run.smithi124.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-12-24T21:56:07.573 INFO:teuthology.orchestra.run.smithi124.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-12-24T21:56:07.573 INFO:teuthology.orchestra.run.smithi124.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-12-24T21:56:07.573 INFO:teuthology.orchestra.run.smithi124.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-12-24T21:56:07.573 INFO:teuthology.orchestra.run.smithi124.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-12-24T21:56:07.574 INFO:teuthology.orchestra.run.smithi124.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-12-24T21:56:07.574 INFO:teuthology.orchestra.run.smithi124.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-12-24T21:56:07.574 INFO:teuthology.orchestra.run.smithi124.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-12-24T21:56:07.574 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:07.574 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2019-12-24T21:56:07.574 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:07.574 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package (+10 Dependent packages) 2019-12-24T21:56:07.575 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:07.575 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 1.6 M 2019-12-24T21:56:07.575 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 24 M 2019-12-24T21:56:07.575 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading packages: 2019-12-24T21:56:08.018 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 9/11 2019-12-24T21:56:08.283 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2019-12-24T21:56:08.283 INFO:teuthology.orchestra.run.smithi124.stdout:Total 2.3 MB/s | 1.6 MB 00:00 2019-12-24T21:56:08.296 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2019-12-24T21:56:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 2/11 2019-12-24T21:56:08.306 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2019-12-24T21:56:08.369 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded 2019-12-24T21:56:08.374 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2019-12-24T21:56:08.460 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-12-24T21:56:08.626 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 3/11 2019-12-24T21:56:08.723 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:ceph-mgr-rook-14.2.5-54.gfd2fdc3.el7.noarch 11/11 2019-12-24T21:56:08.872 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-12-24T21:56:08.981 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-12-24T21:56:09.013 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 4/11 2019-12-24T21:56:09.081 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 3/11 2019-12-24T21:56:09.110 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-12-24T21:56:09.190 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 4/11 2019-12-24T21:56:09.274 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 5/11 2019-12-24T21:56:09.366 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-12-24T21:56:09.368 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 5/11 2019-12-24T21:56:09.727 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 7/11 2019-12-24T21:56:09.735 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 6/11 2019-12-24T21:56:09.844 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 8/11 2019-12-24T21:56:09.944 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 9/11 2019-12-24T21:56:09.975 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 2/11 2019-12-24T21:56:10.053 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:ceph-mgr-rook-14.2.5-54.gfd2fdc3.el7.noarch 10/11 2019-12-24T21:56:10.156 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 7/11 2019-12-24T21:56:10.329 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 3/11 2019-12-24T21:56:10.528 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 8/11 2019-12-24T21:56:10.572 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 11/11 2019-12-24T21:56:10.572 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:10.572 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2019-12-24T21:56:10.572 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook.noarch 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:10.572 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:10.573 INFO:teuthology.orchestra.run.smithi037.stdout:Dependency Installed: 2019-12-24T21:56:10.573 INFO:teuthology.orchestra.run.smithi037.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-12-24T21:56:10.573 INFO:teuthology.orchestra.run.smithi037.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-12-24T21:56:10.573 INFO:teuthology.orchestra.run.smithi037.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-12-24T21:56:10.573 INFO:teuthology.orchestra.run.smithi037.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-12-24T21:56:10.573 INFO:teuthology.orchestra.run.smithi037.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-12-24T21:56:10.573 INFO:teuthology.orchestra.run.smithi037.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-12-24T21:56:10.574 INFO:teuthology.orchestra.run.smithi037.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-12-24T21:56:10.574 INFO:teuthology.orchestra.run.smithi037.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-12-24T21:56:10.574 INFO:teuthology.orchestra.run.smithi037.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-12-24T21:56:10.574 INFO:teuthology.orchestra.run.smithi037.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-12-24T21:56:10.574 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:10.574 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2019-12-24T21:56:10.701 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-fuse 2019-12-24T21:56:10.706 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 4/11 2019-12-24T21:56:10.965 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:11.011 INFO:teuthology.orchestra.run.smithi037.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:11.012 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:56:11.012 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:11.013 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:11.013 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:11.071 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 5/11 2019-12-24T21:56:11.454 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 6/11 2019-12-24T21:56:11.680 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:11.842 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 9/11 2019-12-24T21:56:11.933 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 7/11 2019-12-24T21:56:12.028 INFO:teuthology.orchestra.run.smithi037.stdout:Resolving Dependencies 2019-12-24T21:56:12.029 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:56:12.029 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package ceph-fuse.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:12.260 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-12-24T21:56:12.356 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 8/11 2019-12-24T21:56:12.434 INFO:teuthology.orchestra.run.smithi037.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:ceph-mgr-rook-14.2.5-54.gfd2fdc3.el7.noarch 11/11 2019-12-24T21:56:12.667 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:12.667 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies Resolved 2019-12-24T21:56:12.668 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:12.668 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:12.668 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2019-12-24T21:56:12.668 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:12.668 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2019-12-24T21:56:12.669 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 564 k 2019-12-24T21:56:12.669 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:12.669 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2019-12-24T21:56:12.669 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:12.669 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2019-12-24T21:56:12.669 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:12.669 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 564 k 2019-12-24T21:56:12.669 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 1.5 M 2019-12-24T21:56:12.670 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading packages: 2019-12-24T21:56:13.006 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-12-24T21:56:13.036 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2019-12-24T21:56:13.057 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2019-12-24T21:56:13.058 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded 2019-12-24T21:56:13.059 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2019-12-24T21:56:13.106 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-12-24T21:56:13.190 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 3/11 2019-12-24T21:56:13.282 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 4/11 2019-12-24T21:56:13.391 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 5/11 2019-12-24T21:56:13.533 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-12-24T21:56:13.651 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 7/11 2019-12-24T21:56:13.651 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:ceph-fuse-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:13.717 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 9/11 2019-12-24T21:56:13.751 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 8/11 2019-12-24T21:56:13.885 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 9/11 2019-12-24T21:56:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:ceph-mgr-rook-14.2.5-54.gfd2fdc3.el7.noarch 10/11 2019-12-24T21:56:14.100 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:ceph-fuse-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:14.100 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:14.100 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2019-12-24T21:56:14.100 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:14.100 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:14.101 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2019-12-24T21:56:14.180 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-12-24T21:56:14.221 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install librados-devel 2019-12-24T21:56:14.448 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:14.492 INFO:teuthology.orchestra.run.smithi037.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:14.493 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:56:14.493 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:14.494 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:14.494 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:14.539 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 11/11 2019-12-24T21:56:14.539 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:14.539 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2019-12-24T21:56:14.539 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook.noarch 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:14.539 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:14.540 INFO:teuthology.orchestra.run.smithi006.stdout:Dependency Installed: 2019-12-24T21:56:14.540 INFO:teuthology.orchestra.run.smithi006.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-12-24T21:56:14.540 INFO:teuthology.orchestra.run.smithi006.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-12-24T21:56:14.540 INFO:teuthology.orchestra.run.smithi006.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-12-24T21:56:14.540 INFO:teuthology.orchestra.run.smithi006.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-12-24T21:56:14.540 INFO:teuthology.orchestra.run.smithi006.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-12-24T21:56:14.540 INFO:teuthology.orchestra.run.smithi006.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-12-24T21:56:14.541 INFO:teuthology.orchestra.run.smithi006.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-12-24T21:56:14.541 INFO:teuthology.orchestra.run.smithi006.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-12-24T21:56:14.541 INFO:teuthology.orchestra.run.smithi006.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-12-24T21:56:14.541 INFO:teuthology.orchestra.run.smithi006.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-12-24T21:56:14.541 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:14.541 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2019-12-24T21:56:14.669 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-fuse 2019-12-24T21:56:14.803 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:ceph-mgr-rook-14.2.5-54.gfd2fdc3.el7.noarch 11/11 2019-12-24T21:56:14.906 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:14.943 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-12-24T21:56:14.948 INFO:teuthology.orchestra.run.smithi006.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:14.949 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:56:14.950 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:14.950 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:14.950 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:15.086 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-12-24T21:56:15.164 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:15.169 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 3/11 2019-12-24T21:56:15.278 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 4/11 2019-12-24T21:56:15.398 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 5/11 2019-12-24T21:56:15.504 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-12-24T21:56:15.511 INFO:teuthology.orchestra.run.smithi037.stdout:Resolving Dependencies 2019-12-24T21:56:15.511 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:56:15.512 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package librados-devel.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:15.621 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:15.646 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 7/11 2019-12-24T21:56:15.722 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 8/11 2019-12-24T21:56:15.831 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 9/11 2019-12-24T21:56:15.907 INFO:teuthology.orchestra.run.smithi037.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:15.964 INFO:teuthology.orchestra.run.smithi006.stdout:Resolving Dependencies 2019-12-24T21:56:15.965 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:56:15.965 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package ceph-fuse.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:15.973 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:ceph-mgr-rook-14.2.5-54.gfd2fdc3.el7.noarch 10/11 2019-12-24T21:56:16.141 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:16.141 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies Resolved 2019-12-24T21:56:16.142 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:16.142 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:16.142 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository 2019-12-24T21:56:16.143 INFO:teuthology.orchestra.run.smithi037.stdout: Size 2019-12-24T21:56:16.143 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:16.143 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2019-12-24T21:56:16.143 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 85 k 2019-12-24T21:56:16.143 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:16.143 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2019-12-24T21:56:16.143 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:16.144 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2019-12-24T21:56:16.144 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:16.144 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 85 k 2019-12-24T21:56:16.144 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 296 k 2019-12-24T21:56:16.144 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading packages: 2019-12-24T21:56:16.367 INFO:teuthology.orchestra.run.smithi006.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:16.457 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2019-12-24T21:56:16.481 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2019-12-24T21:56:16.483 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded 2019-12-24T21:56:16.484 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2019-12-24T21:56:16.508 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 11/11 2019-12-24T21:56:16.509 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:16.509 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2019-12-24T21:56:16.509 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-rook.noarch 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:16.509 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:16.509 INFO:teuthology.orchestra.run.smithi124.stdout:Dependency Installed: 2019-12-24T21:56:16.509 INFO:teuthology.orchestra.run.smithi124.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-12-24T21:56:16.510 INFO:teuthology.orchestra.run.smithi124.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-12-24T21:56:16.510 INFO:teuthology.orchestra.run.smithi124.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-12-24T21:56:16.510 INFO:teuthology.orchestra.run.smithi124.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-12-24T21:56:16.510 INFO:teuthology.orchestra.run.smithi124.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-12-24T21:56:16.510 INFO:teuthology.orchestra.run.smithi124.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-12-24T21:56:16.510 INFO:teuthology.orchestra.run.smithi124.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-12-24T21:56:16.511 INFO:teuthology.orchestra.run.smithi124.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-12-24T21:56:16.511 INFO:teuthology.orchestra.run.smithi124.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-12-24T21:56:16.511 INFO:teuthology.orchestra.run.smithi124.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-12-24T21:56:16.511 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:16.511 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2019-12-24T21:56:16.601 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:16.601 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies Resolved 2019-12-24T21:56:16.602 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:16.602 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:16.602 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2019-12-24T21:56:16.602 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:16.603 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2019-12-24T21:56:16.603 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 564 k 2019-12-24T21:56:16.603 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:16.603 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2019-12-24T21:56:16.603 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:16.603 INFO:teuthology.orchestra.run.smithi006.stdout:Install 1 Package 2019-12-24T21:56:16.603 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:16.603 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 564 k 2019-12-24T21:56:16.604 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 1.5 M 2019-12-24T21:56:16.604 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading packages: 2019-12-24T21:56:16.628 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-fuse 2019-12-24T21:56:16.851 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:16.889 INFO:teuthology.orchestra.run.smithi124.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:16.890 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:56:16.890 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:16.891 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:16.891 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:16.988 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2019-12-24T21:56:17.016 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2019-12-24T21:56:17.017 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded 2019-12-24T21:56:17.018 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2019-12-24T21:56:17.030 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:librados-devel-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:17.494 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:librados-devel-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:17.494 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:17.495 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2019-12-24T21:56:17.495 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:17.495 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:17.495 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2019-12-24T21:56:17.532 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:17.575 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:ceph-fuse-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:17.620 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install libcephfs2 2019-12-24T21:56:17.851 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:17.857 INFO:teuthology.orchestra.run.smithi124.stdout:Resolving Dependencies 2019-12-24T21:56:17.858 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:56:17.858 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package ceph-fuse.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:17.896 INFO:teuthology.orchestra.run.smithi037.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:17.897 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:56:17.897 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:17.897 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:17.898 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:18.041 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:ceph-fuse-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:18.041 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:18.042 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2019-12-24T21:56:18.042 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:18.042 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:18.042 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2019-12-24T21:56:18.177 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install librados-devel 2019-12-24T21:56:18.234 INFO:teuthology.orchestra.run.smithi124.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:18.411 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:18.456 INFO:teuthology.orchestra.run.smithi006.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:18.457 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:56:18.458 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:18.458 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:18.458 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:18.459 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies Resolved 2019-12-24T21:56:18.459 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:18.459 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:18.460 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:18.460 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2019-12-24T21:56:18.460 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:18.460 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2019-12-24T21:56:18.460 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-fuse x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 564 k 2019-12-24T21:56:18.460 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:18.460 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2019-12-24T21:56:18.461 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:18.461 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package 2019-12-24T21:56:18.461 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:18.461 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 564 k 2019-12-24T21:56:18.461 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 1.5 M 2019-12-24T21:56:18.461 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading packages: 2019-12-24T21:56:18.564 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:18.832 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2019-12-24T21:56:18.851 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2019-12-24T21:56:18.852 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded 2019-12-24T21:56:18.853 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2019-12-24T21:56:18.914 INFO:teuthology.orchestra.run.smithi037.stdout:Package 2:libcephfs2-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:18.915 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do 2019-12-24T21:56:18.976 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install libcephfs-devel 2019-12-24T21:56:19.150 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:19.153 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:19.191 INFO:teuthology.orchestra.run.smithi037.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:19.192 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:56:19.192 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:19.193 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:19.193 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:19.501 INFO:teuthology.orchestra.run.smithi006.stdout:Resolving Dependencies 2019-12-24T21:56:19.501 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:56:19.501 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package librados-devel.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:19.614 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:ceph-fuse-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:19.824 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:19.902 INFO:teuthology.orchestra.run.smithi006.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:20.061 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:ceph-fuse-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:20.061 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:20.061 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2019-12-24T21:56:20.061 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-fuse.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:20.061 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:20.062 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2019-12-24T21:56:20.137 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:20.137 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies Resolved 2019-12-24T21:56:20.138 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:20.138 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:20.138 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository 2019-12-24T21:56:20.138 INFO:teuthology.orchestra.run.smithi006.stdout: Size 2019-12-24T21:56:20.138 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:20.138 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2019-12-24T21:56:20.139 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 85 k 2019-12-24T21:56:20.139 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:20.139 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2019-12-24T21:56:20.139 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:20.139 INFO:teuthology.orchestra.run.smithi006.stdout:Install 1 Package 2019-12-24T21:56:20.139 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:20.139 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 85 k 2019-12-24T21:56:20.139 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 296 k 2019-12-24T21:56:20.140 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading packages: 2019-12-24T21:56:20.164 INFO:teuthology.orchestra.run.smithi037.stdout:Resolving Dependencies 2019-12-24T21:56:20.165 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:56:20.165 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package libcephfs-devel.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:20.176 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install librados-devel 2019-12-24T21:56:20.397 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:20.440 INFO:teuthology.orchestra.run.smithi124.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:20.441 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:56:20.441 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:20.441 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:20.442 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:20.476 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2019-12-24T21:56:20.500 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2019-12-24T21:56:20.502 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded 2019-12-24T21:56:20.503 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2019-12-24T21:56:20.559 INFO:teuthology.orchestra.run.smithi037.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:20.790 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:20.790 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies Resolved 2019-12-24T21:56:20.791 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:20.791 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:20.791 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository 2019-12-24T21:56:20.791 INFO:teuthology.orchestra.run.smithi037.stdout: Size 2019-12-24T21:56:20.791 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:20.791 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2019-12-24T21:56:20.792 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 17 k 2019-12-24T21:56:20.792 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:20.792 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2019-12-24T21:56:20.792 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:20.792 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2019-12-24T21:56:20.792 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:20.792 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 17 k 2019-12-24T21:56:20.793 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 74 k 2019-12-24T21:56:20.793 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading packages: 2019-12-24T21:56:21.077 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2019-12-24T21:56:21.077 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2019-12-24T21:56:21.078 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded 2019-12-24T21:56:21.078 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2019-12-24T21:56:21.086 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:21.104 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:librados-devel-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:21.419 INFO:teuthology.orchestra.run.smithi124.stdout:Resolving Dependencies 2019-12-24T21:56:21.419 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:56:21.419 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package librados-devel.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:21.593 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:libcephfs-devel-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:21.611 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:librados-devel-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:21.612 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:21.612 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2019-12-24T21:56:21.612 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:21.612 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:21.612 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2019-12-24T21:56:21.730 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install libcephfs2 2019-12-24T21:56:21.794 INFO:teuthology.orchestra.run.smithi124.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:21.957 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:22.000 INFO:teuthology.orchestra.run.smithi006.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:22.001 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:56:22.002 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:22.002 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:22.002 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:22.016 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:22.016 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies Resolved 2019-12-24T21:56:22.017 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:22.017 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:22.017 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository 2019-12-24T21:56:22.018 INFO:teuthology.orchestra.run.smithi124.stdout: Size 2019-12-24T21:56:22.018 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:22.018 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2019-12-24T21:56:22.018 INFO:teuthology.orchestra.run.smithi124.stdout: librados-devel x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 85 k 2019-12-24T21:56:22.018 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:22.018 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2019-12-24T21:56:22.018 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:22.019 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package 2019-12-24T21:56:22.019 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:22.019 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 85 k 2019-12-24T21:56:22.019 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 296 k 2019-12-24T21:56:22.019 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading packages: 2019-12-24T21:56:22.024 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:libcephfs-devel-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:22.024 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:22.024 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2019-12-24T21:56:22.024 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:22.024 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:22.024 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2019-12-24T21:56:22.152 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install librados2 2019-12-24T21:56:22.351 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2019-12-24T21:56:22.373 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2019-12-24T21:56:22.374 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded 2019-12-24T21:56:22.375 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2019-12-24T21:56:22.423 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:22.471 INFO:teuthology.orchestra.run.smithi037.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:22.472 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:56:22.472 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:22.472 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:22.473 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:22.673 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:22.984 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:librados-devel-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:23.021 INFO:teuthology.orchestra.run.smithi006.stdout:Package 2:libcephfs2-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:23.021 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do 2019-12-24T21:56:23.083 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install libcephfs-devel 2019-12-24T21:56:23.151 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:23.252 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:23.288 INFO:teuthology.orchestra.run.smithi006.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:23.289 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:56:23.290 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:23.290 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:23.290 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:23.504 INFO:teuthology.orchestra.run.smithi037.stdout:Package 2:librados2-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:23.505 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do 2019-12-24T21:56:23.549 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:librados-devel-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:23.549 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:23.549 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2019-12-24T21:56:23.549 INFO:teuthology.orchestra.run.smithi124.stdout: librados-devel.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:23.549 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:23.549 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2019-12-24T21:56:23.566 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install librbd1 2019-12-24T21:56:23.679 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install libcephfs2 2019-12-24T21:56:23.728 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:23.765 INFO:teuthology.orchestra.run.smithi037.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:23.765 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:56:23.766 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:23.766 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:23.766 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:23.913 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:23.925 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:23.953 INFO:teuthology.orchestra.run.smithi124.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:23.954 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:56:23.955 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:23.955 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:23.955 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:24.265 INFO:teuthology.orchestra.run.smithi006.stdout:Resolving Dependencies 2019-12-24T21:56:24.266 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:56:24.266 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package libcephfs-devel.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:24.391 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:24.605 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:24.662 INFO:teuthology.orchestra.run.smithi006.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:24.732 INFO:teuthology.orchestra.run.smithi037.stdout:Package 2:librbd1-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:24.733 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do 2019-12-24T21:56:24.795 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-fuse 2019-12-24T21:56:24.889 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:24.889 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies Resolved 2019-12-24T21:56:24.890 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:24.890 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:24.890 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository 2019-12-24T21:56:24.891 INFO:teuthology.orchestra.run.smithi006.stdout: Size 2019-12-24T21:56:24.891 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:24.891 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2019-12-24T21:56:24.891 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 17 k 2019-12-24T21:56:24.891 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:24.891 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2019-12-24T21:56:24.891 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:24.892 INFO:teuthology.orchestra.run.smithi006.stdout:Install 1 Package 2019-12-24T21:56:24.892 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:24.892 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 17 k 2019-12-24T21:56:24.892 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 74 k 2019-12-24T21:56:24.892 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading packages: 2019-12-24T21:56:24.929 INFO:teuthology.orchestra.run.smithi124.stdout:Package 2:libcephfs2-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:24.929 INFO:teuthology.orchestra.run.smithi124.stdout:Nothing to do 2019-12-24T21:56:24.967 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:24.991 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install libcephfs-devel 2019-12-24T21:56:25.004 INFO:teuthology.orchestra.run.smithi037.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:25.007 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:56:25.007 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:25.008 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:25.008 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:25.190 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:25.206 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2019-12-24T21:56:25.207 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2019-12-24T21:56:25.210 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded 2019-12-24T21:56:25.210 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2019-12-24T21:56:25.226 INFO:teuthology.orchestra.run.smithi124.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:25.227 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:56:25.227 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:25.227 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:25.228 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:25.655 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:25.742 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:libcephfs-devel-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:25.813 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:25.997 INFO:teuthology.orchestra.run.smithi037.stdout:Resolving Dependencies 2019-12-24T21:56:25.998 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:56:25.998 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package rbd-fuse.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:26.135 INFO:teuthology.orchestra.run.smithi124.stdout:Resolving Dependencies 2019-12-24T21:56:26.136 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:56:26.136 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package libcephfs-devel.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:26.265 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:libcephfs-devel-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:26.266 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:26.266 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2019-12-24T21:56:26.266 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:26.266 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:26.266 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2019-12-24T21:56:26.386 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install librados2 2019-12-24T21:56:26.399 INFO:teuthology.orchestra.run.smithi037.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:26.504 INFO:teuthology.orchestra.run.smithi124.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:26.626 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:26.633 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:26.633 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies Resolved 2019-12-24T21:56:26.634 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:26.634 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:26.634 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2019-12-24T21:56:26.634 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:26.634 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2019-12-24T21:56:26.634 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 68 k 2019-12-24T21:56:26.635 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:26.635 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2019-12-24T21:56:26.635 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:26.635 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2019-12-24T21:56:26.635 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:26.635 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 68 k 2019-12-24T21:56:26.635 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 176 k 2019-12-24T21:56:26.635 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading packages: 2019-12-24T21:56:26.672 INFO:teuthology.orchestra.run.smithi006.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:26.673 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:56:26.673 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:26.674 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:26.674 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:26.726 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:26.726 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies Resolved 2019-12-24T21:56:26.727 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:26.727 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:26.727 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository 2019-12-24T21:56:26.727 INFO:teuthology.orchestra.run.smithi124.stdout: Size 2019-12-24T21:56:26.727 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:26.728 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2019-12-24T21:56:26.728 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs-devel x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 17 k 2019-12-24T21:56:26.728 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:26.728 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2019-12-24T21:56:26.728 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:26.728 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package 2019-12-24T21:56:26.728 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:26.729 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 17 k 2019-12-24T21:56:26.729 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 74 k 2019-12-24T21:56:26.729 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading packages: 2019-12-24T21:56:26.951 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2019-12-24T21:56:26.976 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2019-12-24T21:56:26.978 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded 2019-12-24T21:56:26.979 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2019-12-24T21:56:27.007 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2019-12-24T21:56:27.008 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2019-12-24T21:56:27.012 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded 2019-12-24T21:56:27.013 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2019-12-24T21:56:27.345 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:27.489 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:rbd-fuse-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:27.604 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:libcephfs-devel-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:27.699 INFO:teuthology.orchestra.run.smithi006.stdout:Package 2:librados2-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:27.699 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do 2019-12-24T21:56:27.762 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install librbd1 2019-12-24T21:56:27.929 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:27.930 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:rbd-fuse-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:27.930 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:27.930 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2019-12-24T21:56:27.930 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:27.930 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:27.931 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2019-12-24T21:56:27.966 INFO:teuthology.orchestra.run.smithi006.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:27.967 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:56:27.967 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:27.967 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:27.968 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:28.011 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:libcephfs-devel-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:28.011 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:28.011 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2019-12-24T21:56:28.011 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs-devel.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:28.012 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:28.012 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2019-12-24T21:56:28.054 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-mirror 2019-12-24T21:56:28.125 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install librados2 2019-12-24T21:56:28.305 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:28.349 INFO:teuthology.orchestra.run.smithi037.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:28.350 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:56:28.351 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:28.351 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:28.352 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:28.384 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:28.429 INFO:teuthology.orchestra.run.smithi124.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:28.430 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:56:28.430 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:28.431 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:28.431 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:28.589 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:28.929 INFO:teuthology.orchestra.run.smithi006.stdout:Package 2:librbd1-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:28.929 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do 2019-12-24T21:56:28.992 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install rbd-fuse 2019-12-24T21:56:29.019 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:29.080 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:29.247 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:29.294 INFO:teuthology.orchestra.run.smithi006.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:29.295 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:56:29.296 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:29.296 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:29.297 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:29.369 INFO:teuthology.orchestra.run.smithi037.stdout:Resolving Dependencies 2019-12-24T21:56:29.370 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:56:29.370 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package rbd-mirror.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:29.419 INFO:teuthology.orchestra.run.smithi124.stdout:Package 2:librados2-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:29.419 INFO:teuthology.orchestra.run.smithi124.stdout:Nothing to do 2019-12-24T21:56:29.479 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install librbd1 2019-12-24T21:56:29.720 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:29.764 INFO:teuthology.orchestra.run.smithi124.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:29.765 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:56:29.766 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:29.766 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:29.766 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:29.769 INFO:teuthology.orchestra.run.smithi037.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:29.966 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:30.002 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:30.002 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies Resolved 2019-12-24T21:56:30.003 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:30.003 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:30.003 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2019-12-24T21:56:30.004 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:30.004 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2019-12-24T21:56:30.004 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 2.2 M 2019-12-24T21:56:30.004 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:30.004 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2019-12-24T21:56:30.004 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:30.005 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2019-12-24T21:56:30.005 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:30.005 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 2.2 M 2019-12-24T21:56:30.005 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 7.8 M 2019-12-24T21:56:30.005 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading packages: 2019-12-24T21:56:30.317 INFO:teuthology.orchestra.run.smithi006.stdout:Resolving Dependencies 2019-12-24T21:56:30.318 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:56:30.318 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package rbd-fuse.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:30.412 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:30.451 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2019-12-24T21:56:30.473 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2019-12-24T21:56:30.474 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded 2019-12-24T21:56:30.475 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2019-12-24T21:56:30.717 INFO:teuthology.orchestra.run.smithi006.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:30.745 INFO:teuthology.orchestra.run.smithi124.stdout:Package 2:librbd1-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:30.745 INFO:teuthology.orchestra.run.smithi124.stdout:Nothing to do 2019-12-24T21:56:30.806 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install rbd-fuse 2019-12-24T21:56:30.950 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:30.950 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies Resolved 2019-12-24T21:56:30.951 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:30.951 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:30.951 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2019-12-24T21:56:30.952 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:30.952 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2019-12-24T21:56:30.952 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 68 k 2019-12-24T21:56:30.952 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:30.952 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2019-12-24T21:56:30.952 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:30.952 INFO:teuthology.orchestra.run.smithi006.stdout:Install 1 Package 2019-12-24T21:56:30.953 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:30.953 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 68 k 2019-12-24T21:56:30.953 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 176 k 2019-12-24T21:56:30.953 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading packages: 2019-12-24T21:56:30.966 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:31.000 INFO:teuthology.orchestra.run.smithi124.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:31.001 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:56:31.001 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:31.001 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:31.002 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:31.288 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2019-12-24T21:56:31.313 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2019-12-24T21:56:31.315 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded 2019-12-24T21:56:31.318 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2019-12-24T21:56:31.426 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:rbd-mirror-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:31.587 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:31.856 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:rbd-fuse-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:31.911 INFO:teuthology.orchestra.run.smithi124.stdout:Resolving Dependencies 2019-12-24T21:56:31.912 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:56:31.912 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package rbd-fuse.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:31.924 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:rbd-mirror-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:31.924 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:31.925 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2019-12-24T21:56:31.925 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:31.925 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:31.925 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2019-12-24T21:56:32.050 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-nbd 2019-12-24T21:56:32.254 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:rbd-fuse-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:32.255 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:32.255 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2019-12-24T21:56:32.255 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:32.255 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:32.255 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2019-12-24T21:56:32.290 INFO:teuthology.orchestra.run.smithi124.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:32.313 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:32.356 INFO:teuthology.orchestra.run.smithi037.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:32.357 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:56:32.357 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:32.358 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:32.358 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:32.404 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install rbd-mirror 2019-12-24T21:56:32.514 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:32.514 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies Resolved 2019-12-24T21:56:32.515 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:32.515 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:32.515 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2019-12-24T21:56:32.515 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:32.516 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2019-12-24T21:56:32.516 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-fuse x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 68 k 2019-12-24T21:56:32.516 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:32.516 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2019-12-24T21:56:32.516 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:32.516 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package 2019-12-24T21:56:32.516 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:32.517 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 68 k 2019-12-24T21:56:32.517 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 176 k 2019-12-24T21:56:32.517 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading packages: 2019-12-24T21:56:32.670 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:32.717 INFO:teuthology.orchestra.run.smithi006.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:32.718 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:56:32.718 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:32.719 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:32.719 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:32.858 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2019-12-24T21:56:32.875 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2019-12-24T21:56:32.876 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded 2019-12-24T21:56:32.876 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2019-12-24T21:56:33.034 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:33.386 INFO:teuthology.orchestra.run.smithi037.stdout:Resolving Dependencies 2019-12-24T21:56:33.387 INFO:teuthology.orchestra.run.smithi037.stdout:--> Running transaction check 2019-12-24T21:56:33.387 INFO:teuthology.orchestra.run.smithi037.stdout:---> Package rbd-nbd.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:33.414 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:33.511 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:rbd-fuse-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:33.768 INFO:teuthology.orchestra.run.smithi006.stdout:Resolving Dependencies 2019-12-24T21:56:33.768 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:56:33.768 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package rbd-mirror.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:33.787 INFO:teuthology.orchestra.run.smithi037.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:33.983 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:rbd-fuse-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:33.983 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:33.984 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2019-12-24T21:56:33.984 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-fuse.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:33.984 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:33.984 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2019-12-24T21:56:34.020 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:34.020 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies Resolved 2019-12-24T21:56:34.021 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:34.021 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:34.021 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2019-12-24T21:56:34.021 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:34.022 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2019-12-24T21:56:34.022 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 131 k 2019-12-24T21:56:34.022 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:34.022 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2019-12-24T21:56:34.022 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2019-12-24T21:56:34.022 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2019-12-24T21:56:34.022 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:34.023 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 131 k 2019-12-24T21:56:34.023 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 375 k 2019-12-24T21:56:34.023 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading packages: 2019-12-24T21:56:34.094 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install rbd-mirror 2019-12-24T21:56:34.166 INFO:teuthology.orchestra.run.smithi006.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:34.310 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:34.353 INFO:teuthology.orchestra.run.smithi124.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:34.353 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:56:34.354 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:34.354 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:34.355 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:34.369 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2019-12-24T21:56:34.384 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2019-12-24T21:56:34.385 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded 2019-12-24T21:56:34.386 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2019-12-24T21:56:34.398 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:34.398 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies Resolved 2019-12-24T21:56:34.399 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:34.399 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:34.399 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2019-12-24T21:56:34.400 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:34.400 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2019-12-24T21:56:34.400 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 2.2 M 2019-12-24T21:56:34.400 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:34.400 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2019-12-24T21:56:34.400 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:34.401 INFO:teuthology.orchestra.run.smithi006.stdout:Install 1 Package 2019-12-24T21:56:34.401 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:34.401 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 2.2 M 2019-12-24T21:56:34.401 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 7.8 M 2019-12-24T21:56:34.401 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading packages: 2019-12-24T21:56:34.848 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2019-12-24T21:56:34.874 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2019-12-24T21:56:34.876 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded 2019-12-24T21:56:34.876 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2019-12-24T21:56:34.935 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : 2:rbd-nbd-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:35.000 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:35.330 INFO:teuthology.orchestra.run.smithi124.stdout:Resolving Dependencies 2019-12-24T21:56:35.331 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:56:35.331 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package rbd-mirror.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:35.424 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : 2:rbd-nbd-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:35.424 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:35.424 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2019-12-24T21:56:35.425 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:35.425 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T21:56:35.425 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2019-12-24T21:56:35.545 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install python-rados 2019-12-24T21:56:35.710 INFO:teuthology.orchestra.run.smithi124.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:35.828 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:35.832 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:rbd-mirror-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:35.875 INFO:teuthology.orchestra.run.smithi037.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:35.876 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:56:35.876 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:35.876 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:35.877 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:35.935 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:35.935 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies Resolved 2019-12-24T21:56:35.936 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:35.936 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:35.936 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2019-12-24T21:56:35.936 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:35.937 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2019-12-24T21:56:35.937 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-mirror x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 2.2 M 2019-12-24T21:56:35.937 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:35.937 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2019-12-24T21:56:35.937 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:35.937 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package 2019-12-24T21:56:35.937 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:35.938 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 2.2 M 2019-12-24T21:56:35.938 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 7.8 M 2019-12-24T21:56:35.938 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading packages: 2019-12-24T21:56:36.291 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:rbd-mirror-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:36.292 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:36.292 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2019-12-24T21:56:36.292 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:36.292 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:36.292 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2019-12-24T21:56:36.384 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2019-12-24T21:56:36.396 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2019-12-24T21:56:36.397 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded 2019-12-24T21:56:36.397 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2019-12-24T21:56:36.418 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install rbd-nbd 2019-12-24T21:56:36.550 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:36.687 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:36.734 INFO:teuthology.orchestra.run.smithi006.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:36.734 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:56:36.735 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:36.735 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:36.736 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:36.905 INFO:teuthology.orchestra.run.smithi037.stdout:Package 2:python-rados-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:36.905 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do 2019-12-24T21:56:36.967 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install python-rgw 2019-12-24T21:56:37.132 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:37.169 INFO:teuthology.orchestra.run.smithi037.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:37.169 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:56:37.170 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:37.170 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:37.170 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:37.401 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:37.477 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:rbd-mirror-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:37.756 INFO:teuthology.orchestra.run.smithi006.stdout:Resolving Dependencies 2019-12-24T21:56:37.757 INFO:teuthology.orchestra.run.smithi006.stdout:--> Running transaction check 2019-12-24T21:56:37.757 INFO:teuthology.orchestra.run.smithi006.stdout:---> Package rbd-nbd.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:37.796 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:37.983 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:rbd-mirror-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:37.984 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:37.984 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2019-12-24T21:56:37.984 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-mirror.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:37.984 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:37.984 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2019-12-24T21:56:38.131 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install rbd-nbd 2019-12-24T21:56:38.137 INFO:teuthology.orchestra.run.smithi037.stdout:Package 2:python-rgw-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:38.137 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do 2019-12-24T21:56:38.155 INFO:teuthology.orchestra.run.smithi006.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:38.199 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install python-rbd 2019-12-24T21:56:38.386 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:38.389 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:38.389 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies Resolved 2019-12-24T21:56:38.390 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:38.390 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:38.390 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2019-12-24T21:56:38.390 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:38.391 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2019-12-24T21:56:38.391 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 131 k 2019-12-24T21:56:38.391 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:38.391 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2019-12-24T21:56:38.391 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2019-12-24T21:56:38.391 INFO:teuthology.orchestra.run.smithi006.stdout:Install 1 Package 2019-12-24T21:56:38.392 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:38.392 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 131 k 2019-12-24T21:56:38.392 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 375 k 2019-12-24T21:56:38.392 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading packages: 2019-12-24T21:56:38.411 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:38.433 INFO:teuthology.orchestra.run.smithi124.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:38.433 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:56:38.434 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:38.434 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:38.434 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:38.456 INFO:teuthology.orchestra.run.smithi037.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:38.460 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:56:38.460 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:38.460 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:38.460 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:38.722 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2019-12-24T21:56:38.748 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2019-12-24T21:56:38.750 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded 2019-12-24T21:56:38.751 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2019-12-24T21:56:39.089 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:39.124 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:39.276 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : 2:rbd-nbd-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:39.422 INFO:teuthology.orchestra.run.smithi124.stdout:Resolving Dependencies 2019-12-24T21:56:39.423 INFO:teuthology.orchestra.run.smithi124.stdout:--> Running transaction check 2019-12-24T21:56:39.423 INFO:teuthology.orchestra.run.smithi124.stdout:---> Package rbd-nbd.x86_64 2:14.2.5-54.gfd2fdc3.el7 will be installed 2019-12-24T21:56:39.468 INFO:teuthology.orchestra.run.smithi037.stdout:Package 2:python-rbd-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:39.469 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do 2019-12-24T21:56:39.530 INFO:teuthology.orchestra.run.smithi037:> sudo yum -y install python-cephfs 2019-12-24T21:56:39.755 INFO:teuthology.orchestra.run.smithi037.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:39.773 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : 2:rbd-nbd-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:39.773 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:39.774 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2019-12-24T21:56:39.774 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:39.774 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:56:39.774 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2019-12-24T21:56:39.801 INFO:teuthology.orchestra.run.smithi037.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:39.802 INFO:teuthology.orchestra.run.smithi124.stdout:--> Finished Dependency Resolution 2019-12-24T21:56:39.802 INFO:teuthology.orchestra.run.smithi037.stdout: * base: reflector.westga.edu 2019-12-24T21:56:39.803 INFO:teuthology.orchestra.run.smithi037.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:39.803 INFO:teuthology.orchestra.run.smithi037.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:39.803 INFO:teuthology.orchestra.run.smithi037.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:39.899 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install python-rados 2019-12-24T21:56:40.025 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:40.026 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies Resolved 2019-12-24T21:56:40.026 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:40.026 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:40.027 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2019-12-24T21:56:40.027 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:40.027 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2019-12-24T21:56:40.027 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-nbd x86_64 2:14.2.5-54.gfd2fdc3.el7 ceph 131 k 2019-12-24T21:56:40.027 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:40.027 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2019-12-24T21:56:40.028 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2019-12-24T21:56:40.028 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package 2019-12-24T21:56:40.028 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:40.028 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 131 k 2019-12-24T21:56:40.028 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 375 k 2019-12-24T21:56:40.028 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading packages: 2019-12-24T21:56:40.133 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:40.177 INFO:teuthology.orchestra.run.smithi006.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:40.178 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:56:40.178 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:40.178 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:40.179 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:40.374 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2019-12-24T21:56:40.391 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2019-12-24T21:56:40.393 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded 2019-12-24T21:56:40.393 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2019-12-24T21:56:40.475 INFO:teuthology.orchestra.run.smithi037.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:40.825 INFO:teuthology.orchestra.run.smithi037.stdout:Package 2:python-cephfs-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:40.825 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do 2019-12-24T21:56:40.864 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:40.888 DEBUG:teuthology.parallel:result is None 2019-12-24T21:56:40.937 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : 2:rbd-nbd-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:41.211 INFO:teuthology.orchestra.run.smithi006.stdout:Package 2:python-rados-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:41.211 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do 2019-12-24T21:56:41.273 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install python-rgw 2019-12-24T21:56:41.504 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : 2:rbd-nbd-14.2.5-54.gfd2fdc3.el7.x86_64 1/1 2019-12-24T21:56:41.504 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:41.504 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2019-12-24T21:56:41.504 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-nbd.x86_64 2:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:41.504 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T21:56:41.504 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2019-12-24T21:56:41.541 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:41.589 INFO:teuthology.orchestra.run.smithi006.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:41.590 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:56:41.590 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:41.590 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:41.591 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:41.619 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install python-rados 2019-12-24T21:56:41.878 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:41.923 INFO:teuthology.orchestra.run.smithi124.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:41.924 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:56:41.928 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:41.928 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:41.928 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:42.262 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:42.580 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:42.614 INFO:teuthology.orchestra.run.smithi006.stdout:Package 2:python-rgw-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:42.614 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do 2019-12-24T21:56:42.676 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install python-rbd 2019-12-24T21:56:42.902 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:42.917 INFO:teuthology.orchestra.run.smithi124.stdout:Package 2:python-rados-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:42.917 INFO:teuthology.orchestra.run.smithi124.stdout:Nothing to do 2019-12-24T21:56:42.943 INFO:teuthology.orchestra.run.smithi006.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:42.944 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:56:42.945 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:42.945 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:42.945 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:42.978 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install python-rgw 2019-12-24T21:56:43.173 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:43.208 INFO:teuthology.orchestra.run.smithi124.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:43.209 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:56:43.210 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:43.210 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:43.210 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:43.621 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:43.792 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:43.967 INFO:teuthology.orchestra.run.smithi006.stdout:Package 2:python-rbd-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:43.967 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do 2019-12-24T21:56:44.029 INFO:teuthology.orchestra.run.smithi006:> sudo yum -y install python-cephfs 2019-12-24T21:56:44.116 INFO:teuthology.orchestra.run.smithi124.stdout:Package 2:python-rgw-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:44.116 INFO:teuthology.orchestra.run.smithi124.stdout:Nothing to do 2019-12-24T21:56:44.177 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install python-rbd 2019-12-24T21:56:44.256 INFO:teuthology.orchestra.run.smithi006.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:44.302 INFO:teuthology.orchestra.run.smithi006.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:44.303 INFO:teuthology.orchestra.run.smithi006.stdout: * base: reflector.westga.edu 2019-12-24T21:56:44.303 INFO:teuthology.orchestra.run.smithi006.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:44.303 INFO:teuthology.orchestra.run.smithi006.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:44.304 INFO:teuthology.orchestra.run.smithi006.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:44.425 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:44.469 INFO:teuthology.orchestra.run.smithi124.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:44.469 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:56:44.470 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:44.470 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:44.470 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:44.972 INFO:teuthology.orchestra.run.smithi006.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:45.118 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:45.324 INFO:teuthology.orchestra.run.smithi006.stdout:Package 2:python-cephfs-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:45.324 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do 2019-12-24T21:56:45.386 DEBUG:teuthology.parallel:result is None 2019-12-24T21:56:45.451 INFO:teuthology.orchestra.run.smithi124.stdout:Package 2:python-rbd-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:45.452 INFO:teuthology.orchestra.run.smithi124.stdout:Nothing to do 2019-12-24T21:56:45.511 INFO:teuthology.orchestra.run.smithi124:> sudo yum -y install python-cephfs 2019-12-24T21:56:45.761 INFO:teuthology.orchestra.run.smithi124.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T21:56:45.807 INFO:teuthology.orchestra.run.smithi124.stdout:Loading mirror speeds from cached hostfile 2019-12-24T21:56:45.808 INFO:teuthology.orchestra.run.smithi124.stdout: * base: reflector.westga.edu 2019-12-24T21:56:45.809 INFO:teuthology.orchestra.run.smithi124.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-24T21:56:45.809 INFO:teuthology.orchestra.run.smithi124.stdout: * extras: mirror.umd.edu 2019-12-24T21:56:45.809 INFO:teuthology.orchestra.run.smithi124.stdout: * updates: mirror.jaleco.com 2019-12-24T21:56:46.457 INFO:teuthology.orchestra.run.smithi124.stdout:7 packages excluded due to repository priority protections 2019-12-24T21:56:46.796 INFO:teuthology.orchestra.run.smithi124.stdout:Package 2:python-cephfs-14.2.5-54.gfd2fdc3.el7.x86_64 already installed and latest version 2019-12-24T21:56:46.796 INFO:teuthology.orchestra.run.smithi124.stdout:Nothing to do 2019-12-24T21:56:46.857 DEBUG:teuthology.parallel:result is None 2019-12-24T21:56:46.857 INFO:teuthology.orchestra.run.smithi006:> sudo lsb_release -is 2019-12-24T21:56:47.012 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS 2019-12-24T21:56:47.014 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-24T21:56:47.014 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-24T21:56:47.014 INFO:teuthology.packaging:ref: None 2019-12-24T21:56:47.014 INFO:teuthology.packaging:tag: None 2019-12-24T21:56:47.014 INFO:teuthology.packaging:branch: nautilus 2019-12-24T21:56:47.014 INFO:teuthology.packaging:sha1: 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 2019-12-24T21:56:47.015 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=nautilus 2019-12-24T21:56:47.398 INFO:teuthology.orchestra.run.smithi006:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-12-24T21:56:47.540 INFO:teuthology.orchestra.run.smithi006.stdout:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:47.541 INFO:teuthology.packaging:The installed version of ceph is 14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:47.541 INFO:teuthology.task.install:The correct ceph version 14.2.5-54.gfd2fdc3 is installed. 2019-12-24T21:56:47.541 INFO:teuthology.orchestra.run.smithi037:> sudo lsb_release -is 2019-12-24T21:56:47.698 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS 2019-12-24T21:56:47.701 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-24T21:56:47.701 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-24T21:56:47.701 INFO:teuthology.packaging:ref: None 2019-12-24T21:56:47.701 INFO:teuthology.packaging:tag: None 2019-12-24T21:56:47.701 INFO:teuthology.packaging:branch: nautilus 2019-12-24T21:56:47.701 INFO:teuthology.packaging:sha1: 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 2019-12-24T21:56:47.702 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=nautilus 2019-12-24T21:56:48.062 INFO:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-12-24T21:56:48.204 INFO:teuthology.orchestra.run.smithi037.stdout:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:48.204 INFO:teuthology.packaging:The installed version of ceph is 14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:48.205 INFO:teuthology.task.install:The correct ceph version 14.2.5-54.gfd2fdc3 is installed. 2019-12-24T21:56:48.205 INFO:teuthology.orchestra.run.smithi124:> sudo lsb_release -is 2019-12-24T21:56:48.355 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS 2019-12-24T21:56:48.357 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-24T21:56:48.357 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-24T21:56:48.357 INFO:teuthology.packaging:ref: None 2019-12-24T21:56:48.357 INFO:teuthology.packaging:tag: None 2019-12-24T21:56:48.358 INFO:teuthology.packaging:branch: nautilus 2019-12-24T21:56:48.358 INFO:teuthology.packaging:sha1: 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 2019-12-24T21:56:48.358 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=nautilus 2019-12-24T21:56:48.722 INFO:teuthology.orchestra.run.smithi124:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-12-24T21:56:48.858 INFO:teuthology.orchestra.run.smithi124.stdout:14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:48.858 INFO:teuthology.packaging:The installed version of ceph is 14.2.5-54.gfd2fdc3.el7 2019-12-24T21:56:48.859 INFO:teuthology.task.install:The correct ceph version 14.2.5-54.gfd2fdc3 is installed. 2019-12-24T21:56:48.859 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2019-12-24T21:56:48.859 INFO:teuthology.orchestra.run.smithi006:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-12-24T21:56:48.982 INFO:teuthology.orchestra.run.smithi037:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-12-24T21:56:49.105 INFO:teuthology.orchestra.run.smithi124:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-12-24T21:56:49.226 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2019-12-24T21:56:49.226 INFO:teuthology.orchestra.run.smithi006:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-12-24T21:56:49.347 INFO:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-12-24T21:56:49.461 INFO:teuthology.orchestra.run.smithi037:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-12-24T21:56:49.587 INFO:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-12-24T21:56:49.700 INFO:teuthology.orchestra.run.smithi124:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-12-24T21:56:49.819 INFO:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-12-24T21:56:49.928 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2019-12-24T21:56:49.928 INFO:teuthology.orchestra.run.smithi006:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-12-24T21:56:50.051 INFO:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-12-24T21:56:50.169 INFO:teuthology.orchestra.run.smithi037:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-12-24T21:56:50.295 INFO:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-12-24T21:56:50.403 INFO:teuthology.orchestra.run.smithi124:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-12-24T21:56:50.518 INFO:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-12-24T21:56:50.609 INFO:teuthology.run_tasks:Running task cephadm... 2019-12-24T21:56:50.679 INFO:tasks.cephadm:Config: {'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MON_DOWN\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow requests'], 'conf': {'client.2': {'debug objecter': 20, 'debug ms': 1, 'debug rados': 20}, 'global': {'osd_pool_default_min_size': 2, 'ms tcp read timeout': 5, 'osd_pool_default_size': 3, 'ms inject socket failures': 2500, 'mon client directed command retry': 5}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'debug ms': 1, 'mon osdmap full prune min': 15, 'mon osdmap full prune interval': 2, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10}, 'osd': {'osd op queue cut off': 'debug_random', 'debug ms': 1, 'debug journal': 20, 'osd scrub max interval': 120, 'osd max backfills': 3, 'debug osd': 25, 'osd snap trim sleep': 2, 'osd debug reject backfill probability': 0.3, 'osd debug verify missing on start': True, 'osd op queue': 'debug_random', 'osd debug verify cached snaps': True, 'osd scrub min interval': 60, 'debug filestore': 20, 'osd shutdown pgref assert': True}}, 'sha1': '7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01'} 2019-12-24T21:56:50.679 INFO:tasks.cephadm:Cluster image is quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 2019-12-24T21:56:50.680 INFO:tasks.cephadm:Cluster fsid is 4a02c23c-2698-11ea-8286-001a4aab830c 2019-12-24T21:56:50.680 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2019-12-24T21:56:50.680 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.37', 'mon.c': '172.21.15.124', 'mon.b': '172.21.15.6'} 2019-12-24T21:56:50.680 INFO:tasks.cephadm:Normalizing hostnames... 2019-12-24T21:56:50.680 INFO:teuthology.orchestra.run.smithi006:> sudo hostname $(hostname -s) 2019-12-24T21:56:50.801 INFO:teuthology.orchestra.run.smithi037:> sudo hostname $(hostname -s) 2019-12-24T21:56:50.926 INFO:teuthology.orchestra.run.smithi124:> sudo hostname $(hostname -s) 2019-12-24T21:56:51.046 INFO:tasks.cephadm:Downloading cephadm (repo git://git.ceph.com/ceph-ci.git ref 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01)... 2019-12-24T21:56:51.046 INFO:teuthology.orchestra.run.smithi006:> git archive --remote=git://git.ceph.com/ceph-ci.git 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && test -s /home/ubuntu/cephtest/cephadm && chmod +x /home/ubuntu/cephtest/cephadm 2019-12-24T21:56:51.304 INFO:teuthology.orchestra.run.smithi037:> git archive --remote=git://git.ceph.com/ceph-ci.git 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && test -s /home/ubuntu/cephtest/cephadm && chmod +x /home/ubuntu/cephtest/cephadm 2019-12-24T21:56:51.557 INFO:teuthology.orchestra.run.smithi124:> git archive --remote=git://git.ceph.com/ceph-ci.git 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && test -s /home/ubuntu/cephtest/cephadm && chmod +x /home/ubuntu/cephtest/cephadm 2019-12-24T21:56:51.814 INFO:tasks.cephadm:First mon is mon.a on smithi037 2019-12-24T21:56:51.815 INFO:tasks.cephadm:others ['mon.a', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-12-24T21:56:51.815 INFO:tasks.cephadm:First mgr is y 2019-12-24T21:56:51.815 INFO:tasks.cephadm:Writing seed config... 2019-12-24T21:56:51.817 INFO:tasks.cephadm: override: [client.2] debug objecter = 20 2019-12-24T21:56:51.817 INFO:tasks.cephadm: override: [client.2] debug ms = 1 2019-12-24T21:56:51.817 INFO:tasks.cephadm: override: [client.2] debug rados = 20 2019-12-24T21:56:51.817 INFO:tasks.cephadm: override: [global] osd_pool_default_min_size = 2 2019-12-24T21:56:51.817 INFO:tasks.cephadm: override: [global] ms tcp read timeout = 5 2019-12-24T21:56:51.818 INFO:tasks.cephadm: override: [global] osd_pool_default_size = 3 2019-12-24T21:56:51.818 INFO:tasks.cephadm: override: [global] ms inject socket failures = 2500 2019-12-24T21:56:51.818 INFO:tasks.cephadm: override: [global] mon client directed command retry = 5 2019-12-24T21:56:51.818 INFO:tasks.cephadm: override: [mon] debug mon = 20 2019-12-24T21:56:51.818 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2019-12-24T21:56:51.818 INFO:tasks.cephadm: override: [mon] mon min osdmap epochs = 50 2019-12-24T21:56:51.818 INFO:tasks.cephadm: override: [mon] debug ms = 1 2019-12-24T21:56:51.819 INFO:tasks.cephadm: override: [mon] mon osdmap full prune min = 15 2019-12-24T21:56:51.819 INFO:tasks.cephadm: override: [mon] mon osdmap full prune interval = 2 2019-12-24T21:56:51.819 INFO:tasks.cephadm: override: [mon] mon osdmap full prune txsize = 2 2019-12-24T21:56:51.819 INFO:tasks.cephadm: override: [mon] paxos service trim min = 10 2019-12-24T21:56:51.819 INFO:tasks.cephadm: override: [osd] osd op queue cut off = debug_random 2019-12-24T21:56:51.819 INFO:tasks.cephadm: override: [osd] debug ms = 1 2019-12-24T21:56:51.819 INFO:tasks.cephadm: override: [osd] debug journal = 20 2019-12-24T21:56:51.819 INFO:tasks.cephadm: override: [osd] osd scrub max interval = 120 2019-12-24T21:56:51.820 INFO:tasks.cephadm: override: [osd] osd max backfills = 3 2019-12-24T21:56:51.820 INFO:tasks.cephadm: override: [osd] debug osd = 25 2019-12-24T21:56:51.820 INFO:tasks.cephadm: override: [osd] osd snap trim sleep = 2 2019-12-24T21:56:51.820 INFO:tasks.cephadm: override: [osd] osd debug reject backfill probability = 0.3 2019-12-24T21:56:51.820 INFO:tasks.cephadm: override: [osd] osd debug verify missing on start = True 2019-12-24T21:56:51.820 INFO:tasks.cephadm: override: [osd] osd op queue = debug_random 2019-12-24T21:56:51.820 INFO:tasks.cephadm: override: [osd] osd debug verify cached snaps = True 2019-12-24T21:56:51.820 INFO:tasks.cephadm: override: [osd] osd scrub min interval = 60 2019-12-24T21:56:51.821 INFO:tasks.cephadm: override: [osd] debug filestore = 20 2019-12-24T21:56:51.821 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2019-12-24T21:56:51.822 INFO:teuthology.orchestra.run.smithi037:> cat > /home/ubuntu/cephtest/seed.ceph.conf 2019-12-24T21:56:51.914 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 4a02c23c-2698-11ea-8286-001a4aab830c osd_pool_default_min_size = 2 ms tcp read timeout = 5 osd_pool_default_size = 3 ms inject socket failures = 2500 mon client directed command retry = 5 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 120 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = True osd debug verify missing on start = True osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug journal = 20 osd max backfills = 3 debug osd = 25 osd snap trim sleep = 2 osd debug reject backfill probability = 0.3 osd scrub min interval = 60 debug filestore = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 debug mon = 20 debug paxos = 20 mon min osdmap epochs = 50 debug ms = 1 mon osdmap full prune min = 15 mon osdmap full prune interval = 2 mon osdmap full prune txsize = 2 paxos service trim min = 10 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client.2] debug objecter = 20 debug ms = 1 debug rados = 20 2019-12-24T21:56:51.914 INFO:tasks.cephadm:Bootstrapping... 2019-12-24T21:56:51.914 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 bootstrap --fsid 4a02c23c-2698-11ea-8286-001a4aab830c --mon-id a --mgr-id y --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /home/ubuntu/cephtest/ceph.conf --output-keyring /home/ubuntu/cephtest/ceph.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --skip-ping-check --mon-ip 172.21.15.37 && sudo chmod +r /home/ubuntu/cephtest/ceph.keyring 2019-12-24T21:56:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:root:Cluster fsid: 4a02c23c-2698-11ea-8286-001a4aab830c 2019-12-24T21:56:52.159 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Pulling latest quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 container... 2019-12-24T21:57:21.359 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Extracting ceph user uid/gid from container image... 2019-12-24T21:57:30.549 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Creating initial keys... 2019-12-24T21:57:35.147 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Creating initial monmap... 2019-12-24T21:57:36.299 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Creating mon... 2019-12-24T21:57:37.970 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Waiting for mon to start... 2019-12-24T21:57:39.874 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Assimilating anything we can from ceph.conf... 2019-12-24T21:57:41.217 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Generating new minimal ceph.conf... 2019-12-24T21:57:42.551 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Restarting the monitor... 2019-12-24T21:57:43.396 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Creating mgr... 2019-12-24T21:57:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Creating crash agent... 2019-12-24T21:57:43.813 INFO:teuthology.orchestra.run.smithi037.stderr:Created symlink from /etc/systemd/system/ceph-4a02c23c-2698-11ea-8286-001a4aab830c.target.wants/ceph-4a02c23c-2698-11ea-8286-001a4aab830c-crash.service to /etc/systemd/system/ceph-4a02c23c-2698-11ea-8286-001a4aab830c-crash.service. 2019-12-24T21:57:43.892 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Wrote keyring to /home/ubuntu/cephtest/ceph.keyring 2019-12-24T21:57:43.892 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Wrote config to /home/ubuntu/cephtest/ceph.conf 2019-12-24T21:57:43.892 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Waiting for mgr to start... 2019-12-24T21:57:45.899 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:mgr is still not available yet, waiting... 2019-12-24T21:57:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:mgr is still not available yet, waiting... 2019-12-24T21:57:50.699 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Enabling cephadm module... 2019-12-24T21:57:52.203 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Setting orchestrator backend to cephadm... 2019-12-24T21:57:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Generating ssh key... 2019-12-24T21:58:00.412 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2019-12-24T21:58:00.412 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Adding key to root@localhost's authorized_keys... 2019-12-24T21:58:00.412 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Adding host smithi037... 2019-12-24T21:58:03.087 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Enabling the dashboard module... 2019-12-24T21:58:05.529 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Waiting for the module to be available... 2019-12-24T21:58:06.753 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Generating a dashboard self-signed certificate... 2019-12-24T21:58:11.627 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Creating initial admin user... 2019-12-24T21:58:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Fetching dashboard port number... 2019-12-24T21:58:14.938 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Ceph Dashboard is now available at: 2019-12-24T21:58:14.939 INFO:teuthology.orchestra.run.smithi037.stderr: 2019-12-24T21:58:14.939 INFO:teuthology.orchestra.run.smithi037.stderr: URL: https://smithi037.front.sepia.ceph.com:8443/ 2019-12-24T21:58:14.939 INFO:teuthology.orchestra.run.smithi037.stderr: User: admin 2019-12-24T21:58:14.939 INFO:teuthology.orchestra.run.smithi037.stderr: Password: 8rhxtuoiu5 2019-12-24T21:58:14.939 INFO:teuthology.orchestra.run.smithi037.stderr: 2019-12-24T21:58:14.939 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:You can access the Ceph CLI with: 2019-12-24T21:58:14.939 INFO:teuthology.orchestra.run.smithi037.stderr: 2019-12-24T21:58:14.940 INFO:teuthology.orchestra.run.smithi037.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring 2019-12-24T21:58:14.940 INFO:teuthology.orchestra.run.smithi037.stderr: 2019-12-24T21:58:14.940 INFO:teuthology.orchestra.run.smithi037.stderr:INFO:cephadm:Bootstrap complete. 2019-12-24T21:58:15.009 INFO:teuthology.orchestra.run.smithi037:mon.a> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 4a02c23c-2698-11ea-8286-001a4aab830c --name mon.a 2019-12-24T21:58:15.015 INFO:teuthology.orchestra.run.smithi037:mgr.y> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 4a02c23c-2698-11ea-8286-001a4aab830c --name mgr.y 2019-12-24T21:58:15.057 INFO:tasks.cephadm:Fetching config... 2019-12-24T21:58:15.158 DEBUG:teuthology.orchestra.remote:smithi037:/home/ubuntu/cephtest/ceph.conf is 175B 2019-12-24T21:58:15.207 INFO:tasks.cephadm:Fetching client.admin keyring... 2019-12-24T21:58:15.253 DEBUG:teuthology.orchestra.remote:smithi037:/home/ubuntu/cephtest/ceph.keyring is 63B 2019-12-24T21:58:15.281 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.955+0000 7f6c562c56c0 0 set uid:gid to 167:167 (ceph:ceph) 2019-12-24T21:58:15.281 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.955+0000 7f6c562c56c0 0 ceph version 15.0.0-8840-g7b0bf18 (7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01) octopus (dev), process ceph-mon, pid 1 2019-12-24T21:58:15.281 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.955+0000 7f6c562c56c0 0 pidfile_write: ignore empty --pid-file 2019-12-24T21:58:15.281 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.960+0000 7f6c562c56c0 0 load: jerasure load: lrc load: isa 2019-12-24T21:58:15.282 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.960+0000 7f6c562c56c0 0 set rocksdb option compression = kNoCompression 2019-12-24T21:58:15.282 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.960+0000 7f6c562c56c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2019-12-24T21:58:15.282 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.960+0000 7f6c562c56c0 0 set rocksdb option write_buffer_size = 33554432 2019-12-24T21:58:15.282 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.960+0000 7f6c562c56c0 0 set rocksdb option compression = kNoCompression 2019-12-24T21:58:15.282 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.960+0000 7f6c562c56c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2019-12-24T21:58:15.282 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.960+0000 7f6c562c56c0 0 set rocksdb option write_buffer_size = 33554432 2019-12-24T21:58:15.282 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 1 rocksdb: do_open column families: [default] 2019-12-24T21:58:15.283 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: RocksDB version: 6.1.2 2019-12-24T21:58:15.283 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.283 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2019-12-24T21:58:15.283 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Compile date Dec 24 2019 2019-12-24T21:58:15.283 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: DB SUMMARY 2019-12-24T21:58:15.283 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.283 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: CURRENT file: CURRENT 2019-12-24T21:58:15.284 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.284 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: IDENTITY file: IDENTITY 2019-12-24T21:58:15.284 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.284 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 109 Bytes 2019-12-24T21:58:15.285 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.285 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2019-12-24T21:58:15.285 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.285 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 73913 ; 2019-12-24T21:58:15.285 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.285 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.error_if_exists: 0 2019-12-24T21:58:15.285 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.create_if_missing: 0 2019-12-24T21:58:15.286 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.paranoid_checks: 1 2019-12-24T21:58:15.286 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.env: 0x557232a6d260 2019-12-24T21:58:15.286 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.info_log: 0x5572339f24c0 2019-12-24T21:58:15.286 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_file_opening_threads: 16 2019-12-24T21:58:15.286 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.statistics: (nil) 2019-12-24T21:58:15.286 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.use_fsync: 0 2019-12-24T21:58:15.287 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_log_file_size: 0 2019-12-24T21:58:15.287 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2019-12-24T21:58:15.287 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.log_file_time_to_roll: 0 2019-12-24T21:58:15.287 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.keep_log_file_num: 1000 2019-12-24T21:58:15.287 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.recycle_log_file_num: 0 2019-12-24T21:58:15.287 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.allow_fallocate: 1 2019-12-24T21:58:15.289 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.allow_mmap_reads: 0 2019-12-24T21:58:15.289 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.allow_mmap_writes: 0 2019-12-24T21:58:15.289 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.use_direct_reads: 0 2019-12-24T21:58:15.289 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2019-12-24T21:58:15.289 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.create_missing_column_families: 0 2019-12-24T21:58:15.289 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.db_log_dir: 2019-12-24T21:58:15.290 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2019-12-24T21:58:15.290 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.table_cache_numshardbits: 6 2019-12-24T21:58:15.290 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_subcompactions: 1 2019-12-24T21:58:15.290 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_background_flushes: -1 2019-12-24T21:58:15.290 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2019-12-24T21:58:15.290 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2019-12-24T21:58:15.290 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2019-12-24T21:58:15.291 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2019-12-24T21:58:15.291 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.advise_random_on_open: 1 2019-12-24T21:58:15.291 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.db_write_buffer_size: 0 2019-12-24T21:58:15.291 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.write_buffer_manager: 0x55723459a9f0 2019-12-24T21:58:15.291 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2019-12-24T21:58:15.291 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2019-12-24T21:58:15.291 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2019-12-24T21:58:15.291 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.use_adaptive_mutex: 0 2019-12-24T21:58:15.292 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.rate_limiter: (nil) 2019-12-24T21:58:15.292 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2019-12-24T21:58:15.292 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.wal_recovery_mode: 2 2019-12-24T21:58:15.292 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.enable_thread_tracking: 0 2019-12-24T21:58:15.292 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.enable_pipelined_write: 0 2019-12-24T21:58:15.292 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2019-12-24T21:58:15.292 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2019-12-24T21:58:15.293 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2019-12-24T21:58:15.293 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2019-12-24T21:58:15.293 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.row_cache: None 2019-12-24T21:58:15.293 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.wal_filter: None 2019-12-24T21:58:15.293 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2019-12-24T21:58:15.293 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.allow_ingest_behind: 0 2019-12-24T21:58:15.293 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.preserve_deletes: 0 2019-12-24T21:58:15.294 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.two_write_queues: 0 2019-12-24T21:58:15.294 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.manual_wal_flush: 0 2019-12-24T21:58:15.294 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.atomic_flush: 0 2019-12-24T21:58:15.294 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2019-12-24T21:58:15.294 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_background_jobs: 2 2019-12-24T21:58:15.294 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_background_compactions: -1 2019-12-24T21:58:15.294 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2019-12-24T21:58:15.295 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2019-12-24T21:58:15.295 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.delayed_write_rate : 16777216 2019-12-24T21:58:15.295 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_total_wal_size: 0 2019-12-24T21:58:15.295 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2019-12-24T21:58:15.295 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.stats_dump_period_sec: 600 2019-12-24T21:58:15.295 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.stats_persist_period_sec: 600 2019-12-24T21:58:15.295 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2019-12-24T21:58:15.296 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_open_files: -1 2019-12-24T21:58:15.296 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.bytes_per_sync: 0 2019-12-24T21:58:15.296 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2019-12-24T21:58:15.296 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.compaction_readahead_size: 0 2019-12-24T21:58:15.296 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Compression algorithms supported: 2019-12-24T21:58:15.297 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2019-12-24T21:58:15.297 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: kZSTD supported: 0 2019-12-24T21:58:15.297 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: kXpressCompression supported: 0 2019-12-24T21:58:15.297 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: kLZ4HCCompression supported: 1 2019-12-24T21:58:15.297 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: kLZ4Compression supported: 1 2019-12-24T21:58:15.297 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: kBZip2Compression supported: 0 2019-12-24T21:58:15.297 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: kZlibCompression supported: 1 2019-12-24T21:58:15.298 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: kSnappyCompression supported: 1 2019-12-24T21:58:15.298 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2019-12-24T21:58:15.298 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2019-12-24T21:58:15.298 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.298 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2019-12-24T21:58:15.298 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.298 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2019-12-24T21:58:15.298 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.merge_operator: 2019-12-24T21:58:15.299 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.compaction_filter: None 2019-12-24T21:58:15.299 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.compaction_filter_factory: None 2019-12-24T21:58:15.299 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2019-12-24T21:58:15.299 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.table_factory: BlockBasedTable 2019-12-24T21:58:15.299 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55723390e0c8) 2019-12-24T21:58:15.299 INFO:ceph.mon.a.smithi037.stdout: cache_index_and_filter_blocks: 1 2019-12-24T21:58:15.299 INFO:ceph.mon.a.smithi037.stdout: cache_index_and_filter_blocks_with_high_priority: 1 2019-12-24T21:58:15.300 INFO:ceph.mon.a.smithi037.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2019-12-24T21:58:15.300 INFO:ceph.mon.a.smithi037.stdout: pin_top_level_index_and_filter: 1 2019-12-24T21:58:15.300 INFO:ceph.mon.a.smithi037.stdout: index_type: 0 2019-12-24T21:58:15.300 INFO:ceph.mon.a.smithi037.stdout: data_block_index_type: 0 2019-12-24T21:58:15.300 INFO:ceph.mon.a.smithi037.stdout: data_block_hash_table_util_ratio: 0.750000 2019-12-24T21:58:15.300 INFO:ceph.mon.a.smithi037.stdout: hash_index_allow_collision: 1 2019-12-24T21:58:15.300 INFO:ceph.mon.a.smithi037.stdout: checksum: 1 2019-12-24T21:58:15.301 INFO:ceph.mon.a.smithi037.stdout: no_block_cache: 0 2019-12-24T21:58:15.301 INFO:ceph.mon.a.smithi037.stdout: block_cache: 0x557233948210 2019-12-24T21:58:15.301 INFO:ceph.mon.a.smithi037.stdout: block_cache_name: BinnedLRUCache 2019-12-24T21:58:15.301 INFO:ceph.mon.a.smithi037.stdout: block_cache_options: 2019-12-24T21:58:15.301 INFO:ceph.mon.a.smithi037.stdout: capacity : 536870912 2019-12-24T21:58:15.301 INFO:ceph.mon.a.smithi037.stdout: num_shard_bits : 4 2019-12-24T21:58:15.301 INFO:ceph.mon.a.smithi037.stdout: strict_capacity_limit : 0 2019-12-24T21:58:15.302 INFO:ceph.mon.a.smithi037.stdout: high_pri_pool_ratio: 0.000 2019-12-24T21:58:15.302 INFO:ceph.mon.a.smithi037.stdout: block_cache_compressed: (nil) 2019-12-24T21:58:15.302 INFO:ceph.mon.a.smithi037.stdout: persistent_cache: (nil) 2019-12-24T21:58:15.302 INFO:ceph.mon.a.smithi037.stdout: block_size: 4096 2019-12-24T21:58:15.302 INFO:ceph.mon.a.smithi037.stdout: block_size_deviation: 10 2019-12-24T21:58:15.302 INFO:ceph.mon.a.smithi037.stdout: block_restart_interval: 16 2019-12-24T21:58:15.302 INFO:ceph.mon.a.smithi037.stdout: index_block_restart_interval: 1 2019-12-24T21:58:15.302 INFO:ceph.mon.a.smithi037.stdout: metadata_block_size: 4096 2019-12-24T21:58:15.303 INFO:ceph.mon.a.smithi037.stdout: partition_filters: 0 2019-12-24T21:58:15.303 INFO:ceph.mon.a.smithi037.stdout: use_delta_encoding: 1 2019-12-24T21:58:15.303 INFO:ceph.mon.a.smithi037.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2019-12-24T21:58:15.303 INFO:ceph.mon.a.smithi037.stdout: whole_key_filtering: 1 2019-12-24T21:58:15.303 INFO:ceph.mon.a.smithi037.stdout: verify_compression: 0 2019-12-24T21:58:15.303 INFO:ceph.mon.a.smithi037.stdout: read_amp_bytes_per_bit: 0 2019-12-24T21:58:15.303 INFO:ceph.mon.a.smithi037.stdout: format_version: 2 2019-12-24T21:58:15.304 INFO:ceph.mon.a.smithi037.stdout: enable_index_compression: 1 2019-12-24T21:58:15.304 INFO:ceph.mon.a.smithi037.stdout: block_align: 0 2019-12-24T21:58:15.304 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.304 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.write_buffer_size: 33554432 2019-12-24T21:58:15.304 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_write_buffer_number: 2 2019-12-24T21:58:15.305 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.compression: NoCompression 2019-12-24T21:58:15.305 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.bottommost_compression: Disabled 2019-12-24T21:58:15.305 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.prefix_extractor: nullptr 2019-12-24T21:58:15.305 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2019-12-24T21:58:15.305 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.num_levels: 7 2019-12-24T21:58:15.305 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2019-12-24T21:58:15.305 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2019-12-24T21:58:15.306 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2019-12-24T21:58:15.306 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2019-12-24T21:58:15.306 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2019-12-24T21:58:15.306 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2019-12-24T21:58:15.306 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2019-12-24T21:58:15.306 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2019-12-24T21:58:15.306 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.compression_opts.window_bits: -14 2019-12-24T21:58:15.306 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.compression_opts.level: 32767 2019-12-24T21:58:15.307 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.compression_opts.strategy: 0 2019-12-24T21:58:15.307 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2019-12-24T21:58:15.307 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2019-12-24T21:58:15.307 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.compression_opts.enabled: false 2019-12-24T21:58:15.307 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2019-12-24T21:58:15.307 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2019-12-24T21:58:15.307 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2019-12-24T21:58:15.308 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.target_file_size_base: 67108864 2019-12-24T21:58:15.308 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.target_file_size_multiplier: 1 2019-12-24T21:58:15.308 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2019-12-24T21:58:15.308 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2019-12-24T21:58:15.308 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2019-12-24T21:58:15.308 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2019-12-24T21:58:15.308 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2019-12-24T21:58:15.309 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2019-12-24T21:58:15.309 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2019-12-24T21:58:15.309 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2019-12-24T21:58:15.309 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2019-12-24T21:58:15.309 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2019-12-24T21:58:15.309 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2019-12-24T21:58:15.309 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2019-12-24T21:58:15.310 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.arena_block_size: 4194304 2019-12-24T21:58:15.310 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2019-12-24T21:58:15.310 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2019-12-24T21:58:15.310 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2019-12-24T21:58:15.310 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.disable_auto_compactions: 0 2019-12-24T21:58:15.310 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 2019-12-24T21:58:15.310 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2019-12-24T21:58:15.311 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2019-12-24T21:58:15.311 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2019-12-24T21:58:15.311 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2019-12-24T21:58:15.311 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2019-12-24T21:58:15.312 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2019-12-24T21:58:15.312 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2019-12-24T21:58:15.312 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2019-12-24T21:58:15.312 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2019-12-24T21:58:15.313 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.table_properties_collectors: 2019-12-24T21:58:15.313 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.inplace_update_support: 0 2019-12-24T21:58:15.319 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2019-12-24T21:58:15.319 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2019-12-24T21:58:15.319 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2019-12-24T21:58:15.320 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.memtable_huge_page_size: 0 2019-12-24T21:58:15.320 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.bloom_locality: 0 2019-12-24T21:58:15.320 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.max_successive_merges: 0 2019-12-24T21:58:15.320 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2019-12-24T21:58:15.320 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.paranoid_file_checks: 0 2019-12-24T21:58:15.320 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.force_consistency_checks: 0 2019-12-24T21:58:15.320 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.report_bg_io_stats: 0 2019-12-24T21:58:15.321 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.961+0000 7f6c562c56c0 4 rocksdb: Options.ttl: 0 2019-12-24T21:58:15.321 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.962+0000 7f6c562c56c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2019-12-24T21:58:15.321 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.321 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.962+0000 7f6c562c56c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 4 2019-12-24T21:58:15.321 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.321 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.962+0000 7f6c562c56c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577224663963404, "job": 1, "event": "recovery_started", "log_files": [6]} 2019-12-24T21:58:15.321 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.962+0000 7f6c562c56c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #6 mode 2 2019-12-24T21:58:15.322 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.963+0000 7f6c562c56c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577224663964520, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 70115, "table_properties": {"data_size": 68435, "index_size": 285, "filter_size": 581, "raw_key_size": 10444, "raw_average_key_size": 49, "raw_value_size": 62655, "raw_average_value_size": 294, "num_data_blocks": 10, "num_entries": 213, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2019-12-24T21:58:15.322 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.963+0000 7f6c562c56c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 8 2019-12-24T21:58:15.322 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.322 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.964+0000 7f6c562c56c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577224663965333, "job": 1, "event": "recovery_finished"} 2019-12-24T21:58:15.322 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.966+0000 7f6c562c56c0 4 rocksdb: DB pointer 0x55723457d200 2019-12-24T21:58:15.322 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.966+0000 7f6c3d3f8700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2019-12-24T21:58:15.322 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.966+0000 7f6c3d3f8700 4 rocksdb: [db/db_impl.cc:778] 2019-12-24T21:58:15.323 INFO:ceph.mon.a.smithi037.stdout:** DB Stats ** 2019-12-24T21:58:15.323 INFO:ceph.mon.a.smithi037.stdout:Uptime(secs): 0.0 total, 0.0 interval 2019-12-24T21:58:15.323 INFO:ceph.mon.a.smithi037.stdout:Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2019-12-24T21:58:15.323 INFO:ceph.mon.a.smithi037.stdout:Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2019-12-24T21:58:15.323 INFO:ceph.mon.a.smithi037.stdout:Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2019-12-24T21:58:15.323 INFO:ceph.mon.a.smithi037.stdout:Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2019-12-24T21:58:15.323 INFO:ceph.mon.a.smithi037.stdout:Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2019-12-24T21:58:15.324 INFO:ceph.mon.a.smithi037.stdout:Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2019-12-24T21:58:15.324 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.324 INFO:ceph.mon.a.smithi037.stdout:** Compaction Stats [default] ** 2019-12-24T21:58:15.324 INFO:ceph.mon.a.smithi037.stdout:Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-24T21:58:15.324 INFO:ceph.mon.a.smithi037.stdout:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-24T21:58:15.324 INFO:ceph.mon.a.smithi037.stdout: L0 2/0 70.22 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 84.9 0.00 0.00 1 0.001 0 0 2019-12-24T21:58:15.324 INFO:ceph.mon.a.smithi037.stdout: Sum 2/0 70.22 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 84.9 0.00 0.00 1 0.001 0 0 2019-12-24T21:58:15.325 INFO:ceph.mon.a.smithi037.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 84.9 0.00 0.00 1 0.001 0 0 2019-12-24T21:58:15.325 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.325 INFO:ceph.mon.a.smithi037.stdout:** Compaction Stats [default] ** 2019-12-24T21:58:15.325 INFO:ceph.mon.a.smithi037.stdout:Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-24T21:58:15.325 INFO:ceph.mon.a.smithi037.stdout:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-24T21:58:15.325 INFO:ceph.mon.a.smithi037.stdout:User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 84.9 0.00 0.00 1 0.001 0 0 2019-12-24T21:58:15.325 INFO:ceph.mon.a.smithi037.stdout:Uptime(secs): 0.0 total, 0.0 interval 2019-12-24T21:58:15.326 INFO:ceph.mon.a.smithi037.stdout:Flush(GB): cumulative 0.000, interval 0.000 2019-12-24T21:58:15.326 INFO:ceph.mon.a.smithi037.stdout:AddFile(GB): cumulative 0.000, interval 0.000 2019-12-24T21:58:15.326 INFO:ceph.mon.a.smithi037.stdout:AddFile(Total Files): cumulative 0, interval 0 2019-12-24T21:58:15.326 INFO:ceph.mon.a.smithi037.stdout:AddFile(L0 Files): cumulative 0, interval 0 2019-12-24T21:58:15.326 INFO:ceph.mon.a.smithi037.stdout:AddFile(Keys): cumulative 0, interval 0 2019-12-24T21:58:15.326 INFO:ceph.mon.a.smithi037.stdout:Cumulative compaction: 0.00 GB write, 14.07 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-24T21:58:15.326 INFO:ceph.mon.a.smithi037.stdout:Interval compaction: 0.00 GB write, 14.07 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-24T21:58:15.326 INFO:ceph.mon.a.smithi037.stdout:Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2019-12-24T21:58:15.327 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.327 INFO:ceph.mon.a.smithi037.stdout:** File Read Latency Histogram By Level [default] ** 2019-12-24T21:58:15.327 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.327 INFO:ceph.mon.a.smithi037.stdout:** Compaction Stats [default] ** 2019-12-24T21:58:15.327 INFO:ceph.mon.a.smithi037.stdout:Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-24T21:58:15.327 INFO:ceph.mon.a.smithi037.stdout:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-24T21:58:15.327 INFO:ceph.mon.a.smithi037.stdout: L0 2/0 70.22 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 84.9 0.00 0.00 1 0.001 0 0 2019-12-24T21:58:15.328 INFO:ceph.mon.a.smithi037.stdout: Sum 2/0 70.22 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 84.9 0.00 0.00 1 0.001 0 0 2019-12-24T21:58:15.328 INFO:ceph.mon.a.smithi037.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2019-12-24T21:58:15.328 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.328 INFO:ceph.mon.a.smithi037.stdout:** Compaction Stats [default] ** 2019-12-24T21:58:15.328 INFO:ceph.mon.a.smithi037.stdout:Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-24T21:58:15.328 INFO:ceph.mon.a.smithi037.stdout:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-24T21:58:15.328 INFO:ceph.mon.a.smithi037.stdout:User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 84.9 0.00 0.00 1 0.001 0 0 2019-12-24T21:58:15.329 INFO:ceph.mon.a.smithi037.stdout:Uptime(secs): 0.0 total, 0.0 interval 2019-12-24T21:58:15.329 INFO:ceph.mon.a.smithi037.stdout:Flush(GB): cumulative 0.000, interval 0.000 2019-12-24T21:58:15.329 INFO:ceph.mon.a.smithi037.stdout:AddFile(GB): cumulative 0.000, interval 0.000 2019-12-24T21:58:15.329 INFO:ceph.mon.a.smithi037.stdout:AddFile(Total Files): cumulative 0, interval 0 2019-12-24T21:58:15.329 INFO:ceph.mon.a.smithi037.stdout:AddFile(L0 Files): cumulative 0, interval 0 2019-12-24T21:58:15.329 INFO:ceph.mon.a.smithi037.stdout:AddFile(Keys): cumulative 0, interval 0 2019-12-24T21:58:15.329 INFO:ceph.mon.a.smithi037.stdout:Cumulative compaction: 0.00 GB write, 13.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-24T21:58:15.330 INFO:ceph.mon.a.smithi037.stdout:Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-24T21:58:15.330 INFO:ceph.mon.a.smithi037.stdout:Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2019-12-24T21:58:15.330 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.330 INFO:ceph.mon.a.smithi037.stdout:** File Read Latency Histogram By Level [default] ** 2019-12-24T21:58:15.330 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.330 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.967+0000 7f6c562c56c0 0 starting mon.a rank 0 at public addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] at bind addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 4a02c23c-2698-11ea-8286-001a4aab830c 2019-12-24T21:58:15.330 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.968+0000 7f6c562c56c0 1 mon.a@-1(???) e1 preinit fsid 4a02c23c-2698-11ea-8286-001a4aab830c 2019-12-24T21:58:15.330 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.968+0000 7f6c562c56c0 0 mon.a@-1(???).mds e1 new map 2019-12-24T21:58:15.331 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.968+0000 7f6c562c56c0 0 mon.a@-1(???).mds e1 print_map 2019-12-24T21:58:15.331 INFO:ceph.mon.a.smithi037.stdout:e1 2019-12-24T21:58:15.331 INFO:ceph.mon.a.smithi037.stdout:enable_multiple, ever_enabled_multiple: 0,0 2019-12-24T21:58:15.331 INFO:ceph.mon.a.smithi037.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2019-12-24T21:58:15.331 INFO:ceph.mon.a.smithi037.stdout:legacy client fscid: -1 2019-12-24T21:58:15.331 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.331 INFO:ceph.mon.a.smithi037.stdout:No filesystems configured 2019-12-24T21:58:15.332 INFO:ceph.mon.a.smithi037.stdout: 2019-12-24T21:58:15.332 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.968+0000 7f6c562c56c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2019-12-24T21:58:15.332 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.968+0000 7f6c562c56c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2019-12-24T21:58:15.332 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.968+0000 7f6c562c56c0 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2019-12-24T21:58:15.332 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.968+0000 7f6c562c56c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2019-12-24T21:58:15.332 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T21:57:43.968+0000 7f6c562c56c0 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2019-12-24T21:58:15.334 INFO:ceph.mgr.y.smithi037.stdout:ignoring --setuser ceph since I am not root 2019-12-24T21:58:15.334 INFO:ceph.mgr.y.smithi037.stdout:ignoring --setgroup ceph since I am not root 2019-12-24T21:58:15.334 INFO:ceph.mgr.y.smithi037.stdout:Generating public/private rsa key pair. 2019-12-24T21:58:15.334 INFO:ceph.mgr.y.smithi037.stdout:Your identification has been saved in /tmp/tmpa7z_qqqs/key. 2019-12-24T21:58:15.334 INFO:ceph.mgr.y.smithi037.stdout:Your public key has been saved in /tmp/tmpa7z_qqqs/key.pub. 2019-12-24T21:58:15.335 INFO:ceph.mgr.y.smithi037.stdout:The key fingerprint is: 2019-12-24T21:58:15.335 INFO:ceph.mgr.y.smithi037.stdout:SHA256:Yh0VKzg8bnwUcDVJT8m8D66L39YpizV2fZXqW5KlC0k ceph-4a02c23c-2698-11ea-8286-001a4aab830c 2019-12-24T21:58:15.335 INFO:ceph.mgr.y.smithi037.stdout:The key's randomart image is: 2019-12-24T21:58:15.335 INFO:ceph.mgr.y.smithi037.stdout:+---[RSA 2048]----+ 2019-12-24T21:58:15.335 INFO:ceph.mgr.y.smithi037.stdout:| ..oo*=.. | 2019-12-24T21:58:15.335 INFO:ceph.mgr.y.smithi037.stdout:| . o o.=+ | 2019-12-24T21:58:15.335 INFO:ceph.mgr.y.smithi037.stdout:| = + . .. | 2019-12-24T21:58:15.336 INFO:ceph.mgr.y.smithi037.stdout:| o = o o .| 2019-12-24T21:58:15.336 INFO:ceph.mgr.y.smithi037.stdout:| * S E o o.| 2019-12-24T21:58:15.336 INFO:ceph.mgr.y.smithi037.stdout:| o o . o *..| 2019-12-24T21:58:15.336 INFO:ceph.mgr.y.smithi037.stdout:| ++*.oo| 2019-12-24T21:58:15.336 INFO:ceph.mgr.y.smithi037.stdout:| ..==o* .| 2019-12-24T21:58:15.336 INFO:ceph.mgr.y.smithi037.stdout:| ..+oo*. | 2019-12-24T21:58:15.336 INFO:ceph.mgr.y.smithi037.stdout:+----[SHA256]-----+ 2019-12-24T21:58:15.337 INFO:ceph.mgr.y.smithi037.stdout:ignoring --setuser ceph since I am not root 2019-12-24T21:58:15.337 INFO:ceph.mgr.y.smithi037.stdout:ignoring --setgroup ceph since I am not root 2019-12-24T21:58:15.341 INFO:tasks.cephadm:Fetching mon keyring... 2019-12-24T21:58:15.341 INFO:teuthology.orchestra.run.smithi037:> mktemp 2019-12-24T21:58:15.402 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.Tc4l3qxbWM 2019-12-24T21:58:15.403 INFO:teuthology.orchestra.run.smithi037:> sudo cp /var/lib/ceph/4a02c23c-2698-11ea-8286-001a4aab830c/mon.a/keyring /tmp/tmp.Tc4l3qxbWM 2019-12-24T21:58:15.564 INFO:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.Tc4l3qxbWM 2019-12-24T21:58:15.772 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.Tc4l3qxbWM is 77B 2019-12-24T21:58:15.851 INFO:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.Tc4l3qxbWM 2019-12-24T21:58:15.925 INFO:tasks.cephadm:Fetching pub ssh key... 2019-12-24T21:58:16.056 DEBUG:teuthology.orchestra.remote:smithi037:/home/ubuntu/cephtest/ceph.pub is 423B 2019-12-24T21:58:16.145 INFO:tasks.cephadm:Installing pub ssh key for root users... 2019-12-24T21:58:16.145 INFO:teuthology.orchestra.run.smithi006:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDetwGqN8jNeD3i8IL5WNJJFZIDEyt2khhgndr8bzFJLqhQoKUaJltOz4v66l+pbO/aHOhEe7dKVwYSHiPU572pFP1A1TSl0/PTxn0WbdXy4QIuADKPtOdtxuHNRuhcvGS5DDUawKKKMOdBq9djZg2OCoo4jzPzyBkzGoK9ibJAcBY9MVSipuQeYUL6NmG70gcD8my9u1zORjK1BjgHzjxBiQEvgDihe8Q0U8SJLoRWx5cGQa52cQbexZctZPWA+8MCPCmKixeJFA8uxHs6rYdUSQrRr9K+giCiS+UyQx0U+Ey4JJgW4Opb3HTOGKLttRcAbpJXMBkQfEYWyySgXIIz ceph-4a02c23c-2698-11ea-8286-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2019-12-24T21:58:16.299 INFO:teuthology.orchestra.run.smithi006.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDetwGqN8jNeD3i8IL5WNJJFZIDEyt2khhgndr8bzFJLqhQoKUaJltOz4v66l+pbO/aHOhEe7dKVwYSHiPU572pFP1A1TSl0/PTxn0WbdXy4QIuADKPtOdtxuHNRuhcvGS5DDUawKKKMOdBq9djZg2OCoo4jzPzyBkzGoK9ibJAcBY9MVSipuQeYUL6NmG70gcD8my9u1zORjK1BjgHzjxBiQEvgDihe8Q0U8SJLoRWx5cGQa52cQbexZctZPWA+8MCPCmKixeJFA8uxHs6rYdUSQrRr9K+giCiS+UyQx0U+Ey4JJgW4Opb3HTOGKLttRcAbpJXMBkQfEYWyySgXIIz ceph-4a02c23c-2698-11ea-8286-001a4aab830c 2019-12-24T21:58:16.334 INFO:teuthology.orchestra.run.smithi037:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDetwGqN8jNeD3i8IL5WNJJFZIDEyt2khhgndr8bzFJLqhQoKUaJltOz4v66l+pbO/aHOhEe7dKVwYSHiPU572pFP1A1TSl0/PTxn0WbdXy4QIuADKPtOdtxuHNRuhcvGS5DDUawKKKMOdBq9djZg2OCoo4jzPzyBkzGoK9ibJAcBY9MVSipuQeYUL6NmG70gcD8my9u1zORjK1BjgHzjxBiQEvgDihe8Q0U8SJLoRWx5cGQa52cQbexZctZPWA+8MCPCmKixeJFA8uxHs6rYdUSQrRr9K+giCiS+UyQx0U+Ey4JJgW4Opb3HTOGKLttRcAbpJXMBkQfEYWyySgXIIz ceph-4a02c23c-2698-11ea-8286-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2019-12-24T21:58:16.483 INFO:teuthology.orchestra.run.smithi037.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDetwGqN8jNeD3i8IL5WNJJFZIDEyt2khhgndr8bzFJLqhQoKUaJltOz4v66l+pbO/aHOhEe7dKVwYSHiPU572pFP1A1TSl0/PTxn0WbdXy4QIuADKPtOdtxuHNRuhcvGS5DDUawKKKMOdBq9djZg2OCoo4jzPzyBkzGoK9ibJAcBY9MVSipuQeYUL6NmG70gcD8my9u1zORjK1BjgHzjxBiQEvgDihe8Q0U8SJLoRWx5cGQa52cQbexZctZPWA+8MCPCmKixeJFA8uxHs6rYdUSQrRr9K+giCiS+UyQx0U+Ey4JJgW4Opb3HTOGKLttRcAbpJXMBkQfEYWyySgXIIz ceph-4a02c23c-2698-11ea-8286-001a4aab830c 2019-12-24T21:58:16.517 INFO:teuthology.orchestra.run.smithi124:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDetwGqN8jNeD3i8IL5WNJJFZIDEyt2khhgndr8bzFJLqhQoKUaJltOz4v66l+pbO/aHOhEe7dKVwYSHiPU572pFP1A1TSl0/PTxn0WbdXy4QIuADKPtOdtxuHNRuhcvGS5DDUawKKKMOdBq9djZg2OCoo4jzPzyBkzGoK9ibJAcBY9MVSipuQeYUL6NmG70gcD8my9u1zORjK1BjgHzjxBiQEvgDihe8Q0U8SJLoRWx5cGQa52cQbexZctZPWA+8MCPCmKixeJFA8uxHs6rYdUSQrRr9K+giCiS+UyQx0U+Ey4JJgW4Opb3HTOGKLttRcAbpJXMBkQfEYWyySgXIIz ceph-4a02c23c-2698-11ea-8286-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2019-12-24T21:58:16.665 INFO:teuthology.orchestra.run.smithi124.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDetwGqN8jNeD3i8IL5WNJJFZIDEyt2khhgndr8bzFJLqhQoKUaJltOz4v66l+pbO/aHOhEe7dKVwYSHiPU572pFP1A1TSl0/PTxn0WbdXy4QIuADKPtOdtxuHNRuhcvGS5DDUawKKKMOdBq9djZg2OCoo4jzPzyBkzGoK9ibJAcBY9MVSipuQeYUL6NmG70gcD8my9u1zORjK1BjgHzjxBiQEvgDihe8Q0U8SJLoRWx5cGQa52cQbexZctZPWA+8MCPCmKixeJFA8uxHs6rYdUSQrRr9K+giCiS+UyQx0U+Ey4JJgW4Opb3HTOGKLttRcAbpJXMBkQfEYWyySgXIIz ceph-4a02c23c-2698-11ea-8286-001a4aab830c 2019-12-24T21:58:16.694 INFO:tasks.cephadm:Writing conf and keyring to smithi006 2019-12-24T21:58:16.694 INFO:teuthology.orchestra.run.smithi006:> cat > /home/ubuntu/cephtest/ceph.conf 2019-12-24T21:58:16.780 INFO:teuthology.orchestra.run.smithi006:> cat > /home/ubuntu/cephtest/ceph.keyring 2019-12-24T21:58:16.866 INFO:tasks.cephadm:Adding host smithi006 to orchestrator... 2019-12-24T21:58:16.867 INFO:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator host add smithi006 2019-12-24T21:58:58.677 INFO:teuthology.orchestra.run.smithi006.stdout:Added host 'smithi006' 2019-12-24T21:58:59.422 INFO:tasks.cephadm:Writing conf and keyring to smithi124 2019-12-24T21:58:59.422 INFO:teuthology.orchestra.run.smithi124:> cat > /home/ubuntu/cephtest/ceph.conf 2019-12-24T21:58:59.511 INFO:teuthology.orchestra.run.smithi124:> cat > /home/ubuntu/cephtest/ceph.keyring 2019-12-24T21:58:59.585 INFO:tasks.cephadm:Adding host smithi124 to orchestrator... 2019-12-24T21:58:59.585 INFO:teuthology.orchestra.run.smithi124:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator host add smithi124 2019-12-24T21:59:39.971 INFO:teuthology.orchestra.run.smithi124.stdout:Added host 'smithi124' 2019-12-24T21:59:40.679 INFO:tasks.cephadm:Adding mon.b on smithi006 2019-12-24T21:59:40.680 INFO:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator mon update 2 smithi006:172.21.15.6=b 2019-12-24T21:59:43.376 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi006,172.21.15.6' (ECDSA) to the list of known hosts. 2019-12-24T21:59:44.378 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi037,172.21.15.37' (ECDSA) to the list of known hosts. 2019-12-24T21:59:45.378 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi124,172.21.15.124' (ECDSA) to the list of known hosts. 2019-12-24T21:59:46.378 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi006,172.21.15.6' (ECDSA) to the list of known hosts. 2019-12-24T21:59:50.200 INFO:teuthology.orchestra.run.smithi006.stdout:["Deployed mon.b on host 'smithi006'"] 2019-12-24T21:59:51.029 INFO:teuthology.orchestra.run.smithi006:mon.b> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 4a02c23c-2698-11ea-8286-001a4aab830c --name mon.b 2019-12-24T21:59:51.035 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2019-12-24T21:59:51.035 INFO:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph mon dump -f json 2019-12-24T21:59:51.307 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.752+0000 7f50f27036c0 0 set uid:gid to 167:167 (ceph:ceph) 2019-12-24T21:59:51.307 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.752+0000 7f50f27036c0 0 ceph version 15.0.0-8840-g7b0bf18 (7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01) octopus (dev), process ceph-mon, pid 1 2019-12-24T21:59:51.307 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.753+0000 7f50f27036c0 0 pidfile_write: ignore empty --pid-file 2019-12-24T21:59:51.307 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.762+0000 7f50f27036c0 0 load: jerasure load: lrc load: isa 2019-12-24T21:59:51.307 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.762+0000 7f50f27036c0 0 set rocksdb option compression = kNoCompression 2019-12-24T21:59:51.308 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.762+0000 7f50f27036c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2019-12-24T21:59:51.308 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.762+0000 7f50f27036c0 0 set rocksdb option write_buffer_size = 33554432 2019-12-24T21:59:51.308 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.762+0000 7f50f27036c0 0 set rocksdb option compression = kNoCompression 2019-12-24T21:59:51.308 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.762+0000 7f50f27036c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2019-12-24T21:59:51.308 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.762+0000 7f50f27036c0 0 set rocksdb option write_buffer_size = 33554432 2019-12-24T21:59:51.308 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 1 rocksdb: do_open column families: [default] 2019-12-24T21:59:51.309 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: RocksDB version: 6.1.2 2019-12-24T21:59:51.309 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.309 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2019-12-24T21:59:51.309 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Compile date Dec 24 2019 2019-12-24T21:59:51.309 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: DB SUMMARY 2019-12-24T21:59:51.310 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.310 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: CURRENT file: CURRENT 2019-12-24T21:59:51.310 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.310 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: IDENTITY file: IDENTITY 2019-12-24T21:59:51.310 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.310 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2019-12-24T21:59:51.310 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.311 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2019-12-24T21:59:51.311 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.311 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000003.log size: 489 ; 2019-12-24T21:59:51.311 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.311 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.error_if_exists: 0 2019-12-24T21:59:51.311 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.create_if_missing: 0 2019-12-24T21:59:51.312 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.paranoid_checks: 1 2019-12-24T21:59:51.312 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.env: 0x558e7ca98260 2019-12-24T21:59:51.312 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.info_log: 0x558e7e07e4c0 2019-12-24T21:59:51.312 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.max_file_opening_threads: 16 2019-12-24T21:59:51.312 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.statistics: (nil) 2019-12-24T21:59:51.312 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.use_fsync: 0 2019-12-24T21:59:51.312 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.max_log_file_size: 0 2019-12-24T21:59:51.313 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2019-12-24T21:59:51.313 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.log_file_time_to_roll: 0 2019-12-24T21:59:51.313 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.keep_log_file_num: 1000 2019-12-24T21:59:51.313 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.recycle_log_file_num: 0 2019-12-24T21:59:51.314 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.allow_fallocate: 1 2019-12-24T21:59:51.314 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.allow_mmap_reads: 0 2019-12-24T21:59:51.314 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.allow_mmap_writes: 0 2019-12-24T21:59:51.314 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.use_direct_reads: 0 2019-12-24T21:59:51.314 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2019-12-24T21:59:51.314 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.create_missing_column_families: 0 2019-12-24T21:59:51.315 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.db_log_dir: 2019-12-24T21:59:51.315 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2019-12-24T21:59:51.315 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.table_cache_numshardbits: 6 2019-12-24T21:59:51.315 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.max_subcompactions: 1 2019-12-24T21:59:51.315 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.max_background_flushes: -1 2019-12-24T21:59:51.315 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2019-12-24T21:59:51.315 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2019-12-24T21:59:51.316 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2019-12-24T21:59:51.316 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2019-12-24T21:59:51.316 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.advise_random_on_open: 1 2019-12-24T21:59:51.316 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.db_write_buffer_size: 0 2019-12-24T21:59:51.316 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.write_buffer_manager: 0x558e7ec269f0 2019-12-24T21:59:51.316 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2019-12-24T21:59:51.317 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2019-12-24T21:59:51.317 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2019-12-24T21:59:51.317 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.use_adaptive_mutex: 0 2019-12-24T21:59:51.317 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.rate_limiter: (nil) 2019-12-24T21:59:51.317 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2019-12-24T21:59:51.317 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.wal_recovery_mode: 2 2019-12-24T21:59:51.318 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.enable_thread_tracking: 0 2019-12-24T21:59:51.318 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.enable_pipelined_write: 0 2019-12-24T21:59:51.318 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2019-12-24T21:59:51.318 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2019-12-24T21:59:51.318 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2019-12-24T21:59:51.318 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2019-12-24T21:59:51.318 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.row_cache: None 2019-12-24T21:59:51.319 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.wal_filter: None 2019-12-24T21:59:51.319 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2019-12-24T21:59:51.319 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.allow_ingest_behind: 0 2019-12-24T21:59:51.319 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.preserve_deletes: 0 2019-12-24T21:59:51.319 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.two_write_queues: 0 2019-12-24T21:59:51.320 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.manual_wal_flush: 0 2019-12-24T21:59:51.320 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.atomic_flush: 0 2019-12-24T21:59:51.320 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2019-12-24T21:59:51.320 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.max_background_jobs: 2 2019-12-24T21:59:51.321 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.max_background_compactions: -1 2019-12-24T21:59:51.321 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2019-12-24T21:59:51.321 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2019-12-24T21:59:51.321 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.delayed_write_rate : 16777216 2019-12-24T21:59:51.321 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.max_total_wal_size: 0 2019-12-24T21:59:51.321 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2019-12-24T21:59:51.322 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.stats_dump_period_sec: 600 2019-12-24T21:59:51.322 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.stats_persist_period_sec: 600 2019-12-24T21:59:51.322 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2019-12-24T21:59:51.322 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.max_open_files: -1 2019-12-24T21:59:51.322 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.bytes_per_sync: 0 2019-12-24T21:59:51.322 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2019-12-24T21:59:51.322 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Options.compaction_readahead_size: 0 2019-12-24T21:59:51.323 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Compression algorithms supported: 2019-12-24T21:59:51.323 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2019-12-24T21:59:51.323 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: kZSTD supported: 0 2019-12-24T21:59:51.323 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: kXpressCompression supported: 0 2019-12-24T21:59:51.323 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: kLZ4HCCompression supported: 1 2019-12-24T21:59:51.323 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: kLZ4Compression supported: 1 2019-12-24T21:59:51.323 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: kBZip2Compression supported: 0 2019-12-24T21:59:51.324 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: kZlibCompression supported: 1 2019-12-24T21:59:51.324 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: kSnappyCompression supported: 1 2019-12-24T21:59:51.324 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.763+0000 7f50f27036c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2019-12-24T21:59:51.324 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 2019-12-24T21:59:51.325 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.325 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2019-12-24T21:59:51.325 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.325 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2019-12-24T21:59:51.325 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.merge_operator: 2019-12-24T21:59:51.325 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.compaction_filter: None 2019-12-24T21:59:51.325 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.compaction_filter_factory: None 2019-12-24T21:59:51.326 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2019-12-24T21:59:51.326 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.table_factory: BlockBasedTable 2019-12-24T21:59:51.326 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558e7df9a0c8) 2019-12-24T21:59:51.326 INFO:ceph.mon.b.smithi006.stdout: cache_index_and_filter_blocks: 1 2019-12-24T21:59:51.326 INFO:ceph.mon.b.smithi006.stdout: cache_index_and_filter_blocks_with_high_priority: 1 2019-12-24T21:59:51.326 INFO:ceph.mon.b.smithi006.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2019-12-24T21:59:51.327 INFO:ceph.mon.b.smithi006.stdout: pin_top_level_index_and_filter: 1 2019-12-24T21:59:51.327 INFO:ceph.mon.b.smithi006.stdout: index_type: 0 2019-12-24T21:59:51.327 INFO:ceph.mon.b.smithi006.stdout: data_block_index_type: 0 2019-12-24T21:59:51.327 INFO:ceph.mon.b.smithi006.stdout: data_block_hash_table_util_ratio: 0.750000 2019-12-24T21:59:51.327 INFO:ceph.mon.b.smithi006.stdout: hash_index_allow_collision: 1 2019-12-24T21:59:51.327 INFO:ceph.mon.b.smithi006.stdout: checksum: 1 2019-12-24T21:59:51.328 INFO:ceph.mon.b.smithi006.stdout: no_block_cache: 0 2019-12-24T21:59:51.328 INFO:ceph.mon.b.smithi006.stdout: block_cache: 0x558e7dfd4210 2019-12-24T21:59:51.328 INFO:ceph.mon.b.smithi006.stdout: block_cache_name: BinnedLRUCache 2019-12-24T21:59:51.328 INFO:ceph.mon.b.smithi006.stdout: block_cache_options: 2019-12-24T21:59:51.328 INFO:ceph.mon.b.smithi006.stdout: capacity : 536870912 2019-12-24T21:59:51.328 INFO:ceph.mon.b.smithi006.stdout: num_shard_bits : 4 2019-12-24T21:59:51.328 INFO:ceph.mon.b.smithi006.stdout: strict_capacity_limit : 0 2019-12-24T21:59:51.329 INFO:ceph.mon.b.smithi006.stdout: high_pri_pool_ratio: 0.000 2019-12-24T21:59:51.329 INFO:ceph.mon.b.smithi006.stdout: block_cache_compressed: (nil) 2019-12-24T21:59:51.329 INFO:ceph.mon.b.smithi006.stdout: persistent_cache: (nil) 2019-12-24T21:59:51.329 INFO:ceph.mon.b.smithi006.stdout: block_size: 4096 2019-12-24T21:59:51.329 INFO:ceph.mon.b.smithi006.stdout: block_size_deviation: 10 2019-12-24T21:59:51.329 INFO:ceph.mon.b.smithi006.stdout: block_restart_interval: 16 2019-12-24T21:59:51.330 INFO:ceph.mon.b.smithi006.stdout: index_block_restart_interval: 1 2019-12-24T21:59:51.330 INFO:ceph.mon.b.smithi006.stdout: metadata_block_size: 4096 2019-12-24T21:59:51.330 INFO:ceph.mon.b.smithi006.stdout: partition_filters: 0 2019-12-24T21:59:51.330 INFO:ceph.mon.b.smithi006.stdout: use_delta_encoding: 1 2019-12-24T21:59:51.330 INFO:ceph.mon.b.smithi006.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2019-12-24T21:59:51.330 INFO:ceph.mon.b.smithi006.stdout: whole_key_filtering: 1 2019-12-24T21:59:51.331 INFO:ceph.mon.b.smithi006.stdout: verify_compression: 0 2019-12-24T21:59:51.331 INFO:ceph.mon.b.smithi006.stdout: read_amp_bytes_per_bit: 0 2019-12-24T21:59:51.331 INFO:ceph.mon.b.smithi006.stdout: format_version: 2 2019-12-24T21:59:51.331 INFO:ceph.mon.b.smithi006.stdout: enable_index_compression: 1 2019-12-24T21:59:51.331 INFO:ceph.mon.b.smithi006.stdout: block_align: 0 2019-12-24T21:59:51.331 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.332 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.write_buffer_size: 33554432 2019-12-24T21:59:51.332 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.max_write_buffer_number: 2 2019-12-24T21:59:51.332 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.compression: NoCompression 2019-12-24T21:59:51.332 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.bottommost_compression: Disabled 2019-12-24T21:59:51.332 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.prefix_extractor: nullptr 2019-12-24T21:59:51.333 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2019-12-24T21:59:51.333 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.num_levels: 7 2019-12-24T21:59:51.333 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2019-12-24T21:59:51.333 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2019-12-24T21:59:51.333 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2019-12-24T21:59:51.333 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2019-12-24T21:59:51.334 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2019-12-24T21:59:51.334 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2019-12-24T21:59:51.334 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2019-12-24T21:59:51.334 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2019-12-24T21:59:51.334 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.compression_opts.window_bits: -14 2019-12-24T21:59:51.335 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.compression_opts.level: 32767 2019-12-24T21:59:51.338 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.compression_opts.strategy: 0 2019-12-24T21:59:51.338 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2019-12-24T21:59:51.338 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2019-12-24T21:59:51.338 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.compression_opts.enabled: false 2019-12-24T21:59:51.339 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2019-12-24T21:59:51.339 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2019-12-24T21:59:51.340 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2019-12-24T21:59:51.340 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.target_file_size_base: 67108864 2019-12-24T21:59:51.341 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.target_file_size_multiplier: 1 2019-12-24T21:59:51.341 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2019-12-24T21:59:51.341 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2019-12-24T21:59:51.341 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2019-12-24T21:59:51.341 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2019-12-24T21:59:51.342 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2019-12-24T21:59:51.342 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2019-12-24T21:59:51.342 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2019-12-24T21:59:51.342 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2019-12-24T21:59:51.343 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2019-12-24T21:59:51.343 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2019-12-24T21:59:51.343 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2019-12-24T21:59:51.344 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2019-12-24T21:59:51.345 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.arena_block_size: 4194304 2019-12-24T21:59:51.345 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2019-12-24T21:59:51.345 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2019-12-24T21:59:51.345 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2019-12-24T21:59:51.346 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.disable_auto_compactions: 0 2019-12-24T21:59:51.346 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2019-12-24T21:59:51.346 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2019-12-24T21:59:51.346 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2019-12-24T21:59:51.346 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2019-12-24T21:59:51.347 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2019-12-24T21:59:51.347 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2019-12-24T21:59:51.347 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2019-12-24T21:59:51.347 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2019-12-24T21:59:51.348 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2019-12-24T21:59:51.348 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2019-12-24T21:59:51.348 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.table_properties_collectors: 2019-12-24T21:59:51.348 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.inplace_update_support: 0 2019-12-24T21:59:51.348 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2019-12-24T21:59:51.349 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2019-12-24T21:59:51.349 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2019-12-24T21:59:51.349 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.memtable_huge_page_size: 0 2019-12-24T21:59:51.350 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.bloom_locality: 0 2019-12-24T21:59:51.350 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.max_successive_merges: 0 2019-12-24T21:59:51.350 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2019-12-24T21:59:51.350 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.paranoid_file_checks: 0 2019-12-24T21:59:51.351 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.force_consistency_checks: 0 2019-12-24T21:59:51.351 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.report_bg_io_stats: 0 2019-12-24T21:59:51.351 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.764+0000 7f50f27036c0 4 rocksdb: Options.ttl: 0 2019-12-24T21:59:51.351 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.765+0000 7f50f27036c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2019-12-24T21:59:51.351 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.352 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.765+0000 7f50f27036c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2019-12-24T21:59:51.352 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.353 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.765+0000 7f50f27036c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577224790766876, "job": 1, "event": "recovery_started", "log_files": [3]} 2019-12-24T21:59:51.353 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.765+0000 7f50f27036c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3 mode 2 2019-12-24T21:59:51.353 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.766+0000 7f50f27036c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577224790767970, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1403, "table_properties": {"data_size": 501, "index_size": 28, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 379, "raw_average_value_size": 75, "num_data_blocks": 1, "num_entries": 5, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2019-12-24T21:59:51.353 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.766+0000 7f50f27036c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 5 2019-12-24T21:59:51.354 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.354 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.767+0000 7f50f27036c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577224790768864, "job": 1, "event": "recovery_finished"} 2019-12-24T21:59:51.354 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.769+0000 7f50f27036c0 4 rocksdb: DB pointer 0x558e7ec09200 2019-12-24T21:59:51.354 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.770+0000 7f50d9836700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2019-12-24T21:59:51.354 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.770+0000 7f50d9836700 4 rocksdb: [db/db_impl.cc:778] 2019-12-24T21:59:51.355 INFO:ceph.mon.b.smithi006.stdout:** DB Stats ** 2019-12-24T21:59:51.355 INFO:ceph.mon.b.smithi006.stdout:Uptime(secs): 0.0 total, 0.0 interval 2019-12-24T21:59:51.355 INFO:ceph.mon.b.smithi006.stdout:Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2019-12-24T21:59:51.355 INFO:ceph.mon.b.smithi006.stdout:Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2019-12-24T21:59:51.356 INFO:ceph.mon.b.smithi006.stdout:Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2019-12-24T21:59:51.356 INFO:ceph.mon.b.smithi006.stdout:Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2019-12-24T21:59:51.356 INFO:ceph.mon.b.smithi006.stdout:Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2019-12-24T21:59:51.356 INFO:ceph.mon.b.smithi006.stdout:Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2019-12-24T21:59:51.356 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.357 INFO:ceph.mon.b.smithi006.stdout:** Compaction Stats [default] ** 2019-12-24T21:59:51.357 INFO:ceph.mon.b.smithi006.stdout:Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-24T21:59:51.357 INFO:ceph.mon.b.smithi006.stdout:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-24T21:59:51.357 INFO:ceph.mon.b.smithi006.stdout: L0 1/0 1.37 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.4 0.00 0.00 1 0.001 0 0 2019-12-24T21:59:51.358 INFO:ceph.mon.b.smithi006.stdout: Sum 1/0 1.37 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.4 0.00 0.00 1 0.001 0 0 2019-12-24T21:59:51.358 INFO:ceph.mon.b.smithi006.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.4 0.00 0.00 1 0.001 0 0 2019-12-24T21:59:51.358 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.358 INFO:ceph.mon.b.smithi006.stdout:** Compaction Stats [default] ** 2019-12-24T21:59:51.358 INFO:ceph.mon.b.smithi006.stdout:Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-24T21:59:51.359 INFO:ceph.mon.b.smithi006.stdout:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-24T21:59:51.359 INFO:ceph.mon.b.smithi006.stdout:User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.4 0.00 0.00 1 0.001 0 0 2019-12-24T21:59:51.359 INFO:ceph.mon.b.smithi006.stdout:Uptime(secs): 0.0 total, 0.0 interval 2019-12-24T21:59:51.359 INFO:ceph.mon.b.smithi006.stdout:Flush(GB): cumulative 0.000, interval 0.000 2019-12-24T21:59:51.360 INFO:ceph.mon.b.smithi006.stdout:AddFile(GB): cumulative 0.000, interval 0.000 2019-12-24T21:59:51.360 INFO:ceph.mon.b.smithi006.stdout:AddFile(Total Files): cumulative 0, interval 0 2019-12-24T21:59:51.360 INFO:ceph.mon.b.smithi006.stdout:AddFile(L0 Files): cumulative 0, interval 0 2019-12-24T21:59:51.361 INFO:ceph.mon.b.smithi006.stdout:AddFile(Keys): cumulative 0, interval 0 2019-12-24T21:59:51.361 INFO:ceph.mon.b.smithi006.stdout:Cumulative compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-24T21:59:51.361 INFO:ceph.mon.b.smithi006.stdout:Interval compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-24T21:59:51.361 INFO:ceph.mon.b.smithi006.stdout:Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2019-12-24T21:59:51.362 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.362 INFO:ceph.mon.b.smithi006.stdout:** File Read Latency Histogram By Level [default] ** 2019-12-24T21:59:51.362 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.363 INFO:ceph.mon.b.smithi006.stdout:** Compaction Stats [default] ** 2019-12-24T21:59:51.363 INFO:ceph.mon.b.smithi006.stdout:Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-24T21:59:51.363 INFO:ceph.mon.b.smithi006.stdout:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-24T21:59:51.363 INFO:ceph.mon.b.smithi006.stdout: L0 1/0 1.37 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.4 0.00 0.00 1 0.001 0 0 2019-12-24T21:59:51.363 INFO:ceph.mon.b.smithi006.stdout: Sum 1/0 1.37 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.4 0.00 0.00 1 0.001 0 0 2019-12-24T21:59:51.364 INFO:ceph.mon.b.smithi006.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2019-12-24T21:59:51.364 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.364 INFO:ceph.mon.b.smithi006.stdout:** Compaction Stats [default] ** 2019-12-24T21:59:51.365 INFO:ceph.mon.b.smithi006.stdout:Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-24T21:59:51.365 INFO:ceph.mon.b.smithi006.stdout:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-24T21:59:51.365 INFO:ceph.mon.b.smithi006.stdout:User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.4 0.00 0.00 1 0.001 0 0 2019-12-24T21:59:51.365 INFO:ceph.mon.b.smithi006.stdout:Uptime(secs): 0.0 total, 0.0 interval 2019-12-24T21:59:51.365 INFO:ceph.mon.b.smithi006.stdout:Flush(GB): cumulative 0.000, interval 0.000 2019-12-24T21:59:51.366 INFO:ceph.mon.b.smithi006.stdout:AddFile(GB): cumulative 0.000, interval 0.000 2019-12-24T21:59:51.366 INFO:ceph.mon.b.smithi006.stdout:AddFile(Total Files): cumulative 0, interval 0 2019-12-24T21:59:51.366 INFO:ceph.mon.b.smithi006.stdout:AddFile(L0 Files): cumulative 0, interval 0 2019-12-24T21:59:51.366 INFO:ceph.mon.b.smithi006.stdout:AddFile(Keys): cumulative 0, interval 0 2019-12-24T21:59:51.367 INFO:ceph.mon.b.smithi006.stdout:Cumulative compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-24T21:59:51.367 INFO:ceph.mon.b.smithi006.stdout:Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-24T21:59:51.367 INFO:ceph.mon.b.smithi006.stdout:Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2019-12-24T21:59:51.367 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.367 INFO:ceph.mon.b.smithi006.stdout:** File Read Latency Histogram By Level [default] ** 2019-12-24T21:59:51.368 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.368 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.770+0000 7f50f27036c0 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2019-12-24T21:59:51.368 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.771+0000 7f50f27036c0 0 using public_addr v2:172.21.15.6:0/0 -> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] 2019-12-24T21:59:51.368 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.772+0000 7f50f27036c0 0 starting mon.b rank -1 at public addrs [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] at bind addrs [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 4a02c23c-2698-11ea-8286-001a4aab830c 2019-12-24T21:59:51.369 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.774+0000 7f50f27036c0 1 mon.b@-1(???) e0 preinit fsid 4a02c23c-2698-11ea-8286-001a4aab830c 2019-12-24T21:59:51.369 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.806+0000 7f50d7832700 4 rocksdb: [db/db_impl_write.cc:1470] [default] New memtable created with log file: #9. Immutable memtables: 0. 2019-12-24T21:59:51.369 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.369 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.807+0000 7f50e1846700 4 rocksdb: (Original Log Time 2019/12/24-21:59:50.808596) [db/db_impl_compaction_flush.cc:2073] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 0 2019-12-24T21:59:51.369 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.807+0000 7f50e1846700 4 rocksdb: [db/flush_job.cc:322] [default] [JOB 3] Flushing memtable with next log file: 9 2019-12-24T21:59:51.370 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.370 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.807+0000 7f50e1846700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577224790808725, "job": 3, "event": "flush_started", "num_memtables": 1, "num_entries": 757, "num_deletes": 22, "total_data_size": 2131986, "memory_usage": 2146056, "flush_reason": "Manual Compaction"} 2019-12-24T21:59:51.370 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.807+0000 7f50e1846700 4 rocksdb: [db/flush_job.cc:351] [default] [JOB 3] Level-0 flush table #10: started 2019-12-24T21:59:51.370 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.810+0000 7f50dc03b700 0 mon.b@-1(synchronizing).mds e1 new map 2019-12-24T21:59:51.371 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.810+0000 7f50dc03b700 0 mon.b@-1(synchronizing).mds e1 print_map 2019-12-24T21:59:51.371 INFO:ceph.mon.b.smithi006.stdout:e1 2019-12-24T21:59:51.371 INFO:ceph.mon.b.smithi006.stdout:enable_multiple, ever_enabled_multiple: 0,0 2019-12-24T21:59:51.371 INFO:ceph.mon.b.smithi006.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2019-12-24T21:59:51.372 INFO:ceph.mon.b.smithi006.stdout:legacy client fscid: -1 2019-12-24T21:59:51.372 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.372 INFO:ceph.mon.b.smithi006.stdout:No filesystems configured 2019-12-24T21:59:51.372 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.372 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.811+0000 7f50dc03b700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2019-12-24T21:59:51.373 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.811+0000 7f50dc03b700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2019-12-24T21:59:51.373 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.811+0000 7f50dc03b700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2019-12-24T21:59:51.373 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.811+0000 7f50dc03b700 0 mon.b@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2019-12-24T21:59:51.373 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.811+0000 7f50dc03b700 0 mon.b@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2019-12-24T21:59:51.374 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.811+0000 7f50dc03b700 0 mon.b@-1(synchronizing).osd e3 crush map has features 3314932999778484224, adjusting msgr requires 2019-12-24T21:59:51.374 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.811+0000 7f50dc03b700 0 mon.b@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2019-12-24T21:59:51.374 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.812+0000 7f50dc03b700 1 mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2019-12-24T21:59:51.374 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.814+0000 7f50e1846700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577224790815613, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 10, "file_size": 1991605, "table_properties": {"data_size": 1986374, "index_size": 3192, "filter_size": 1221, "raw_key_size": 14723, "raw_average_key_size": 33, "raw_value_size": 1975335, "raw_average_value_size": 4479, "num_data_blocks": 106, "num_entries": 441, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2019-12-24T21:59:51.374 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.814+0000 7f50e1846700 4 rocksdb: [db/flush_job.cc:392] [default] [JOB 3] Level-0 flush table #10: 1991605 bytes OK 2019-12-24T21:59:51.375 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.814+0000 7f50e1846700 4 rocksdb: (Original Log Time 2019/12/24-21:59:50.815667) [db/memtable_list.cc:380] [default] Level-0 commit table #10 started 2019-12-24T21:59:51.375 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.814+0000 7f50e1846700 4 rocksdb: (Original Log Time 2019/12/24-21:59:50.815876) [db/memtable_list.cc:428] [default] Level-0 commit table #10: memtable #1 done 2019-12-24T21:59:51.375 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.814+0000 7f50e1846700 4 rocksdb: (Original Log Time 2019/12/24-21:59:50.815902) EVENT_LOG_v1 {"time_micros": 1577224790815888, "job": 3, "event": "flush_finished", "output_compression": "NoCompression", "lsm_state": [2, 0, 0, 0, 0, 0, 0], "immutable_memtables": 0} 2019-12-24T21:59:51.375 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.814+0000 7f50e1846700 4 rocksdb: (Original Log Time 2019/12/24-21:59:50.815918) [db/db_impl_compaction_flush.cc:201] [default] Level summary: files[2 0 0 0 0 0 0] max score 0.50 2019-12-24T21:59:51.376 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.376 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.814+0000 7f50e1846700 4 rocksdb: [db/db_impl_files.cc:356] [JOB 3] Try to delete WAL files size 2126689, prev total WAL file size 2487112, number of live WAL files 2. 2019-12-24T21:59:51.376 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.376 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.814+0000 7f50d7832700 4 rocksdb: [db/db_impl_compaction_flush.cc:1403] [default] Manual compaction starting 2019-12-24T21:59:51.376 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.814+0000 7f50e2047700 4 rocksdb: (Original Log Time 2019/12/24-21:59:50.816291) [db/db_impl_compaction_flush.cc:2374] [default] Manual compaction from level-0 to level-6 from 'mgrstat .. 'mgrstat; will stop at (end) 2019-12-24T21:59:51.377 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.377 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.814+0000 7f50e2047700 4 rocksdb: [db/compaction_job.cc:1645] [default] [JOB 4] Compacting 2@0 files to L6, score -1.00 2019-12-24T21:59:51.378 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.814+0000 7f50e2047700 4 rocksdb: [db/compaction_job.cc:1649] [default] Compaction start summary: Base version 3 Base level 0, inputs: [10(1944KB) 4(1403B)] 2019-12-24T21:59:51.378 INFO:ceph.mon.b.smithi006.stdout: 2019-12-24T21:59:51.378 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.815+0000 7f50e2047700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577224790816570, "job": 4, "event": "compaction_started", "compaction_reason": "ManualCompaction", "files_L0": [10, 4], "score": -1, "input_data_size": 1993008} 2019-12-24T21:59:51.379 INFO:ceph.mon.b.smithi006.stdout:2019-12-24T21:59:50.815+0000 7f50dc03b700 10 mon.b@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete,mon_osdmap_full_prune_interval,mon_osdmap_full_prune_min,mon_osdmap_full_prune_txsize 2019-12-24T21:59:56.329 INFO:teuthology.orchestra.run.smithi006.stdout: 2019-12-24T21:59:56.329 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":2,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","modified":"2019-12-24T21:59:50.823044Z","created":"2019-12-24T21:57:35.728301Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0}],"quorum":[0,1]} 2019-12-24T21:59:56.330 INFO:teuthology.orchestra.run.smithi006.stderr:dumped monmap epoch 2 2019-12-24T21:59:56.978 INFO:tasks.cephadm:Adding mon.c on smithi124 2019-12-24T21:59:56.978 INFO:teuthology.orchestra.run.smithi124:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator mon update 3 smithi124:172.21.15.124=c 2019-12-24T21:59:59.386 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi006,172.21.15.6' (ECDSA) to the list of known hosts. 2019-12-24T22:00:00.637 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi124,172.21.15.124' (ECDSA) to the list of known hosts. 2019-12-24T22:00:04.276 INFO:teuthology.orchestra.run.smithi124.stdout:["Deployed mon.c on host 'smithi124'"] 2019-12-24T22:00:05.099 INFO:teuthology.orchestra.run.smithi124:mon.c> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 4a02c23c-2698-11ea-8286-001a4aab830c --name mon.c 2019-12-24T22:00:05.108 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2019-12-24T22:00:05.108 INFO:teuthology.orchestra.run.smithi124:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph mon dump -f json 2019-12-24T22:00:05.383 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.825+0000 7ff2c29b56c0 0 set uid:gid to 167:167 (ceph:ceph) 2019-12-24T22:00:05.383 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.825+0000 7ff2c29b56c0 0 ceph version 15.0.0-8840-g7b0bf18 (7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01) octopus (dev), process ceph-mon, pid 1 2019-12-24T22:00:05.384 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.825+0000 7ff2c29b56c0 0 pidfile_write: ignore empty --pid-file 2019-12-24T22:00:05.384 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.831+0000 7ff2c29b56c0 0 load: jerasure load: lrc load: isa 2019-12-24T22:00:05.384 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.831+0000 7ff2c29b56c0 0 set rocksdb option compression = kNoCompression 2019-12-24T22:00:05.384 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.831+0000 7ff2c29b56c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2019-12-24T22:00:05.384 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.831+0000 7ff2c29b56c0 0 set rocksdb option write_buffer_size = 33554432 2019-12-24T22:00:05.384 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.831+0000 7ff2c29b56c0 0 set rocksdb option compression = kNoCompression 2019-12-24T22:00:05.384 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.831+0000 7ff2c29b56c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2019-12-24T22:00:05.385 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.831+0000 7ff2c29b56c0 0 set rocksdb option write_buffer_size = 33554432 2019-12-24T22:00:05.385 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.831+0000 7ff2c29b56c0 1 rocksdb: do_open column families: [default] 2019-12-24T22:00:05.385 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: RocksDB version: 6.1.2 2019-12-24T22:00:05.385 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.385 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2019-12-24T22:00:05.385 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Compile date Dec 24 2019 2019-12-24T22:00:05.385 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: DB SUMMARY 2019-12-24T22:00:05.386 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.386 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: CURRENT file: CURRENT 2019-12-24T22:00:05.386 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.386 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: IDENTITY file: IDENTITY 2019-12-24T22:00:05.386 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.386 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2019-12-24T22:00:05.386 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.389 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2019-12-24T22:00:05.390 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.390 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000003.log size: 610 ; 2019-12-24T22:00:05.390 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.391 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.error_if_exists: 0 2019-12-24T22:00:05.393 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.create_if_missing: 0 2019-12-24T22:00:05.393 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.paranoid_checks: 1 2019-12-24T22:00:05.394 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.env: 0x562ae0e69260 2019-12-24T22:00:05.394 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.info_log: 0x562ae301c4c0 2019-12-24T22:00:05.394 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_file_opening_threads: 16 2019-12-24T22:00:05.394 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.statistics: (nil) 2019-12-24T22:00:05.395 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.use_fsync: 0 2019-12-24T22:00:05.395 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_log_file_size: 0 2019-12-24T22:00:05.395 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2019-12-24T22:00:05.395 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.log_file_time_to_roll: 0 2019-12-24T22:00:05.395 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.keep_log_file_num: 1000 2019-12-24T22:00:05.395 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.recycle_log_file_num: 0 2019-12-24T22:00:05.396 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.allow_fallocate: 1 2019-12-24T22:00:05.396 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.allow_mmap_reads: 0 2019-12-24T22:00:05.396 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.allow_mmap_writes: 0 2019-12-24T22:00:05.396 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.use_direct_reads: 0 2019-12-24T22:00:05.396 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2019-12-24T22:00:05.396 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.create_missing_column_families: 0 2019-12-24T22:00:05.396 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.db_log_dir: 2019-12-24T22:00:05.397 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2019-12-24T22:00:05.397 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.table_cache_numshardbits: 6 2019-12-24T22:00:05.397 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_subcompactions: 1 2019-12-24T22:00:05.397 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_background_flushes: -1 2019-12-24T22:00:05.398 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2019-12-24T22:00:05.399 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2019-12-24T22:00:05.399 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2019-12-24T22:00:05.399 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2019-12-24T22:00:05.399 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.advise_random_on_open: 1 2019-12-24T22:00:05.399 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.db_write_buffer_size: 0 2019-12-24T22:00:05.400 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.write_buffer_manager: 0x562ae3bc4990 2019-12-24T22:00:05.400 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2019-12-24T22:00:05.400 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2019-12-24T22:00:05.400 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2019-12-24T22:00:05.400 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.use_adaptive_mutex: 0 2019-12-24T22:00:05.400 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.rate_limiter: (nil) 2019-12-24T22:00:05.400 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2019-12-24T22:00:05.401 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.wal_recovery_mode: 2 2019-12-24T22:00:05.401 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.enable_thread_tracking: 0 2019-12-24T22:00:05.401 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.enable_pipelined_write: 0 2019-12-24T22:00:05.401 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2019-12-24T22:00:05.401 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2019-12-24T22:00:05.401 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2019-12-24T22:00:05.401 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2019-12-24T22:00:05.401 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.row_cache: None 2019-12-24T22:00:05.402 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.wal_filter: None 2019-12-24T22:00:05.402 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2019-12-24T22:00:05.402 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.allow_ingest_behind: 0 2019-12-24T22:00:05.402 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.preserve_deletes: 0 2019-12-24T22:00:05.402 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.two_write_queues: 0 2019-12-24T22:00:05.411 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.manual_wal_flush: 0 2019-12-24T22:00:05.411 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.atomic_flush: 0 2019-12-24T22:00:05.411 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2019-12-24T22:00:05.411 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_background_jobs: 2 2019-12-24T22:00:05.411 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_background_compactions: -1 2019-12-24T22:00:05.412 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2019-12-24T22:00:05.412 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2019-12-24T22:00:05.412 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.delayed_write_rate : 16777216 2019-12-24T22:00:05.412 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_total_wal_size: 0 2019-12-24T22:00:05.412 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2019-12-24T22:00:05.412 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.stats_dump_period_sec: 600 2019-12-24T22:00:05.412 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.stats_persist_period_sec: 600 2019-12-24T22:00:05.413 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2019-12-24T22:00:05.413 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_open_files: -1 2019-12-24T22:00:05.413 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.bytes_per_sync: 0 2019-12-24T22:00:05.413 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2019-12-24T22:00:05.413 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.compaction_readahead_size: 0 2019-12-24T22:00:05.413 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Compression algorithms supported: 2019-12-24T22:00:05.413 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2019-12-24T22:00:05.414 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: kZSTD supported: 0 2019-12-24T22:00:05.414 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: kXpressCompression supported: 0 2019-12-24T22:00:05.414 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: kLZ4HCCompression supported: 1 2019-12-24T22:00:05.414 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: kLZ4Compression supported: 1 2019-12-24T22:00:05.414 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: kBZip2Compression supported: 0 2019-12-24T22:00:05.414 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: kZlibCompression supported: 1 2019-12-24T22:00:05.414 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: kSnappyCompression supported: 1 2019-12-24T22:00:05.415 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2019-12-24T22:00:05.415 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 2019-12-24T22:00:05.415 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.415 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2019-12-24T22:00:05.415 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.415 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2019-12-24T22:00:05.415 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.merge_operator: 2019-12-24T22:00:05.415 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.compaction_filter: None 2019-12-24T22:00:05.416 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.compaction_filter_factory: None 2019-12-24T22:00:05.416 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2019-12-24T22:00:05.416 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.table_factory: BlockBasedTable 2019-12-24T22:00:05.416 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562ae2f380c8) 2019-12-24T22:00:05.416 INFO:ceph.mon.c.smithi124.stdout: cache_index_and_filter_blocks: 1 2019-12-24T22:00:05.416 INFO:ceph.mon.c.smithi124.stdout: cache_index_and_filter_blocks_with_high_priority: 1 2019-12-24T22:00:05.416 INFO:ceph.mon.c.smithi124.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2019-12-24T22:00:05.417 INFO:ceph.mon.c.smithi124.stdout: pin_top_level_index_and_filter: 1 2019-12-24T22:00:05.417 INFO:ceph.mon.c.smithi124.stdout: index_type: 0 2019-12-24T22:00:05.417 INFO:ceph.mon.c.smithi124.stdout: data_block_index_type: 0 2019-12-24T22:00:05.417 INFO:ceph.mon.c.smithi124.stdout: data_block_hash_table_util_ratio: 0.750000 2019-12-24T22:00:05.417 INFO:ceph.mon.c.smithi124.stdout: hash_index_allow_collision: 1 2019-12-24T22:00:05.417 INFO:ceph.mon.c.smithi124.stdout: checksum: 1 2019-12-24T22:00:05.417 INFO:ceph.mon.c.smithi124.stdout: no_block_cache: 0 2019-12-24T22:00:05.418 INFO:ceph.mon.c.smithi124.stdout: block_cache: 0x562ae2f72210 2019-12-24T22:00:05.418 INFO:ceph.mon.c.smithi124.stdout: block_cache_name: BinnedLRUCache 2019-12-24T22:00:05.418 INFO:ceph.mon.c.smithi124.stdout: block_cache_options: 2019-12-24T22:00:05.419 INFO:ceph.mon.c.smithi124.stdout: capacity : 536870912 2019-12-24T22:00:05.419 INFO:ceph.mon.c.smithi124.stdout: num_shard_bits : 4 2019-12-24T22:00:05.419 INFO:ceph.mon.c.smithi124.stdout: strict_capacity_limit : 0 2019-12-24T22:00:05.419 INFO:ceph.mon.c.smithi124.stdout: high_pri_pool_ratio: 0.000 2019-12-24T22:00:05.419 INFO:ceph.mon.c.smithi124.stdout: block_cache_compressed: (nil) 2019-12-24T22:00:05.419 INFO:ceph.mon.c.smithi124.stdout: persistent_cache: (nil) 2019-12-24T22:00:05.419 INFO:ceph.mon.c.smithi124.stdout: block_size: 4096 2019-12-24T22:00:05.420 INFO:ceph.mon.c.smithi124.stdout: block_size_deviation: 10 2019-12-24T22:00:05.420 INFO:ceph.mon.c.smithi124.stdout: block_restart_interval: 16 2019-12-24T22:00:05.420 INFO:ceph.mon.c.smithi124.stdout: index_block_restart_interval: 1 2019-12-24T22:00:05.420 INFO:ceph.mon.c.smithi124.stdout: metadata_block_size: 4096 2019-12-24T22:00:05.420 INFO:ceph.mon.c.smithi124.stdout: partition_filters: 0 2019-12-24T22:00:05.420 INFO:ceph.mon.c.smithi124.stdout: use_delta_encoding: 1 2019-12-24T22:00:05.420 INFO:ceph.mon.c.smithi124.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2019-12-24T22:00:05.421 INFO:ceph.mon.c.smithi124.stdout: whole_key_filtering: 1 2019-12-24T22:00:05.421 INFO:ceph.mon.c.smithi124.stdout: verify_compression: 0 2019-12-24T22:00:05.421 INFO:ceph.mon.c.smithi124.stdout: read_amp_bytes_per_bit: 0 2019-12-24T22:00:05.421 INFO:ceph.mon.c.smithi124.stdout: format_version: 2 2019-12-24T22:00:05.421 INFO:ceph.mon.c.smithi124.stdout: enable_index_compression: 1 2019-12-24T22:00:05.421 INFO:ceph.mon.c.smithi124.stdout: block_align: 0 2019-12-24T22:00:05.421 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.422 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.write_buffer_size: 33554432 2019-12-24T22:00:05.422 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_write_buffer_number: 2 2019-12-24T22:00:05.422 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.compression: NoCompression 2019-12-24T22:00:05.422 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.bottommost_compression: Disabled 2019-12-24T22:00:05.422 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.prefix_extractor: nullptr 2019-12-24T22:00:05.422 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2019-12-24T22:00:05.422 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.num_levels: 7 2019-12-24T22:00:05.423 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2019-12-24T22:00:05.423 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2019-12-24T22:00:05.423 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2019-12-24T22:00:05.423 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2019-12-24T22:00:05.423 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2019-12-24T22:00:05.423 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2019-12-24T22:00:05.423 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2019-12-24T22:00:05.424 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2019-12-24T22:00:05.424 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.compression_opts.window_bits: -14 2019-12-24T22:00:05.424 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.compression_opts.level: 32767 2019-12-24T22:00:05.424 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.compression_opts.strategy: 0 2019-12-24T22:00:05.424 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2019-12-24T22:00:05.424 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2019-12-24T22:00:05.424 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.compression_opts.enabled: false 2019-12-24T22:00:05.425 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2019-12-24T22:00:05.425 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2019-12-24T22:00:05.425 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2019-12-24T22:00:05.425 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.target_file_size_base: 67108864 2019-12-24T22:00:05.426 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.target_file_size_multiplier: 1 2019-12-24T22:00:05.426 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2019-12-24T22:00:05.426 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2019-12-24T22:00:05.426 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2019-12-24T22:00:05.426 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2019-12-24T22:00:05.426 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2019-12-24T22:00:05.426 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2019-12-24T22:00:05.427 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2019-12-24T22:00:05.427 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2019-12-24T22:00:05.427 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2019-12-24T22:00:05.427 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2019-12-24T22:00:05.427 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2019-12-24T22:00:05.427 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2019-12-24T22:00:05.427 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.arena_block_size: 4194304 2019-12-24T22:00:05.427 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2019-12-24T22:00:05.428 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2019-12-24T22:00:05.428 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2019-12-24T22:00:05.428 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.disable_auto_compactions: 0 2019-12-24T22:00:05.434 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2019-12-24T22:00:05.434 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2019-12-24T22:00:05.434 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2019-12-24T22:00:05.434 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2019-12-24T22:00:05.435 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2019-12-24T22:00:05.435 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2019-12-24T22:00:05.435 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2019-12-24T22:00:05.435 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2019-12-24T22:00:05.435 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2019-12-24T22:00:05.435 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2019-12-24T22:00:05.436 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.table_properties_collectors: 2019-12-24T22:00:05.436 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.inplace_update_support: 0 2019-12-24T22:00:05.436 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2019-12-24T22:00:05.436 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2019-12-24T22:00:05.436 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2019-12-24T22:00:05.436 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.memtable_huge_page_size: 0 2019-12-24T22:00:05.436 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.bloom_locality: 0 2019-12-24T22:00:05.437 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.max_successive_merges: 0 2019-12-24T22:00:05.437 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2019-12-24T22:00:05.437 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.paranoid_file_checks: 0 2019-12-24T22:00:05.437 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.force_consistency_checks: 0 2019-12-24T22:00:05.437 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.report_bg_io_stats: 0 2019-12-24T22:00:05.437 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.832+0000 7ff2c29b56c0 4 rocksdb: Options.ttl: 0 2019-12-24T22:00:05.437 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.833+0000 7ff2c29b56c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2019-12-24T22:00:05.438 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.438 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.833+0000 7ff2c29b56c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2019-12-24T22:00:05.438 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.438 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.833+0000 7ff2c29b56c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577224804834385, "job": 1, "event": "recovery_started", "log_files": [3]} 2019-12-24T22:00:05.438 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.833+0000 7ff2c29b56c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3 mode 2 2019-12-24T22:00:05.438 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.834+0000 7ff2c29b56c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577224804835246, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1524, "table_properties": {"data_size": 622, "index_size": 28, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 500, "raw_average_value_size": 100, "num_data_blocks": 1, "num_entries": 5, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2019-12-24T22:00:05.439 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.834+0000 7ff2c29b56c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 5 2019-12-24T22:00:05.439 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.439 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.834+0000 7ff2c29b56c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577224804835962, "job": 1, "event": "recovery_finished"} 2019-12-24T22:00:05.439 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.836+0000 7ff2c29b56c0 4 rocksdb: DB pointer 0x562ae3ba8400 2019-12-24T22:00:05.439 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.836+0000 7ff2a9ae8700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2019-12-24T22:00:05.439 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.836+0000 7ff2a9ae8700 4 rocksdb: [db/db_impl.cc:778] 2019-12-24T22:00:05.439 INFO:ceph.mon.c.smithi124.stdout:** DB Stats ** 2019-12-24T22:00:05.440 INFO:ceph.mon.c.smithi124.stdout:Uptime(secs): 0.0 total, 0.0 interval 2019-12-24T22:00:05.440 INFO:ceph.mon.c.smithi124.stdout:Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2019-12-24T22:00:05.440 INFO:ceph.mon.c.smithi124.stdout:Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2019-12-24T22:00:05.440 INFO:ceph.mon.c.smithi124.stdout:Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2019-12-24T22:00:05.440 INFO:ceph.mon.c.smithi124.stdout:Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2019-12-24T22:00:05.440 INFO:ceph.mon.c.smithi124.stdout:Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2019-12-24T22:00:05.440 INFO:ceph.mon.c.smithi124.stdout:Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2019-12-24T22:00:05.441 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.441 INFO:ceph.mon.c.smithi124.stdout:** Compaction Stats [default] ** 2019-12-24T22:00:05.441 INFO:ceph.mon.c.smithi124.stdout:Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-24T22:00:05.441 INFO:ceph.mon.c.smithi124.stdout:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-24T22:00:05.441 INFO:ceph.mon.c.smithi124.stdout: L0 1/0 1.49 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2019-12-24T22:00:05.441 INFO:ceph.mon.c.smithi124.stdout: Sum 1/0 1.49 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2019-12-24T22:00:05.441 INFO:ceph.mon.c.smithi124.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2019-12-24T22:00:05.444 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.446 INFO:ceph.mon.c.smithi124.stdout:** Compaction Stats [default] ** 2019-12-24T22:00:05.446 INFO:ceph.mon.c.smithi124.stdout:Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-24T22:00:05.446 INFO:ceph.mon.c.smithi124.stdout:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-24T22:00:05.446 INFO:ceph.mon.c.smithi124.stdout:User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2019-12-24T22:00:05.446 INFO:ceph.mon.c.smithi124.stdout:Uptime(secs): 0.0 total, 0.0 interval 2019-12-24T22:00:05.447 INFO:ceph.mon.c.smithi124.stdout:Flush(GB): cumulative 0.000, interval 0.000 2019-12-24T22:00:05.447 INFO:ceph.mon.c.smithi124.stdout:AddFile(GB): cumulative 0.000, interval 0.000 2019-12-24T22:00:05.447 INFO:ceph.mon.c.smithi124.stdout:AddFile(Total Files): cumulative 0, interval 0 2019-12-24T22:00:05.447 INFO:ceph.mon.c.smithi124.stdout:AddFile(L0 Files): cumulative 0, interval 0 2019-12-24T22:00:05.447 INFO:ceph.mon.c.smithi124.stdout:AddFile(Keys): cumulative 0, interval 0 2019-12-24T22:00:05.447 INFO:ceph.mon.c.smithi124.stdout:Cumulative compaction: 0.00 GB write, 0.34 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-24T22:00:05.447 INFO:ceph.mon.c.smithi124.stdout:Interval compaction: 0.00 GB write, 0.34 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-24T22:00:05.448 INFO:ceph.mon.c.smithi124.stdout:Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2019-12-24T22:00:05.448 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.448 INFO:ceph.mon.c.smithi124.stdout:** File Read Latency Histogram By Level [default] ** 2019-12-24T22:00:05.448 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.448 INFO:ceph.mon.c.smithi124.stdout:** Compaction Stats [default] ** 2019-12-24T22:00:05.448 INFO:ceph.mon.c.smithi124.stdout:Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-24T22:00:05.449 INFO:ceph.mon.c.smithi124.stdout:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-24T22:00:05.449 INFO:ceph.mon.c.smithi124.stdout: L0 1/0 1.49 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2019-12-24T22:00:05.449 INFO:ceph.mon.c.smithi124.stdout: Sum 1/0 1.49 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2019-12-24T22:00:05.449 INFO:ceph.mon.c.smithi124.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2019-12-24T22:00:05.449 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.449 INFO:ceph.mon.c.smithi124.stdout:** Compaction Stats [default] ** 2019-12-24T22:00:05.449 INFO:ceph.mon.c.smithi124.stdout:Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-24T22:00:05.450 INFO:ceph.mon.c.smithi124.stdout:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-24T22:00:05.450 INFO:ceph.mon.c.smithi124.stdout:User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2019-12-24T22:00:05.450 INFO:ceph.mon.c.smithi124.stdout:Uptime(secs): 0.0 total, 0.0 interval 2019-12-24T22:00:05.450 INFO:ceph.mon.c.smithi124.stdout:Flush(GB): cumulative 0.000, interval 0.000 2019-12-24T22:00:05.450 INFO:ceph.mon.c.smithi124.stdout:AddFile(GB): cumulative 0.000, interval 0.000 2019-12-24T22:00:05.450 INFO:ceph.mon.c.smithi124.stdout:AddFile(Total Files): cumulative 0, interval 0 2019-12-24T22:00:05.450 INFO:ceph.mon.c.smithi124.stdout:AddFile(L0 Files): cumulative 0, interval 0 2019-12-24T22:00:05.451 INFO:ceph.mon.c.smithi124.stdout:AddFile(Keys): cumulative 0, interval 0 2019-12-24T22:00:05.451 INFO:ceph.mon.c.smithi124.stdout:Cumulative compaction: 0.00 GB write, 0.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-24T22:00:05.451 INFO:ceph.mon.c.smithi124.stdout:Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-24T22:00:05.451 INFO:ceph.mon.c.smithi124.stdout:Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2019-12-24T22:00:05.451 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.451 INFO:ceph.mon.c.smithi124.stdout:** File Read Latency Histogram By Level [default] ** 2019-12-24T22:00:05.451 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.452 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.837+0000 7ff2c29b56c0 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2019-12-24T22:00:05.452 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.837+0000 7ff2c29b56c0 0 using public_addr v2:172.21.15.124:0/0 -> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] 2019-12-24T22:00:05.452 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.838+0000 7ff2c29b56c0 0 starting mon.c rank -1 at public addrs [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] at bind addrs [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 4a02c23c-2698-11ea-8286-001a4aab830c 2019-12-24T22:00:05.452 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.840+0000 7ff2c29b56c0 1 mon.c@-1(???) e0 preinit fsid 4a02c23c-2698-11ea-8286-001a4aab830c 2019-12-24T22:00:05.452 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.864+0000 7ff2a7ae4700 4 rocksdb: [db/db_impl_write.cc:1470] [default] New memtable created with log file: #9. Immutable memtables: 0. 2019-12-24T22:00:05.452 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.453 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.864+0000 7ff2b1af8700 4 rocksdb: (Original Log Time 2019/12/24-22:00:04.865564) [db/db_impl_compaction_flush.cc:2073] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 0 2019-12-24T22:00:05.453 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.864+0000 7ff2b1af8700 4 rocksdb: [db/flush_job.cc:322] [default] [JOB 3] Flushing memtable with next log file: 9 2019-12-24T22:00:05.453 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.453 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.864+0000 7ff2b1af8700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577224804865652, "job": 3, "event": "flush_started", "num_memtables": 1, "num_entries": 757, "num_deletes": 22, "total_data_size": 2131986, "memory_usage": 2146360, "flush_reason": "Manual Compaction"} 2019-12-24T22:00:05.453 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.864+0000 7ff2b1af8700 4 rocksdb: [db/flush_job.cc:351] [default] [JOB 3] Level-0 flush table #10: started 2019-12-24T22:00:05.454 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.870+0000 7ff2b1af8700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577224804871180, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 10, "file_size": 1991605, "table_properties": {"data_size": 1986374, "index_size": 3192, "filter_size": 1221, "raw_key_size": 14723, "raw_average_key_size": 33, "raw_value_size": 1975335, "raw_average_value_size": 4479, "num_data_blocks": 106, "num_entries": 441, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2019-12-24T22:00:05.454 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.870+0000 7ff2b1af8700 4 rocksdb: [db/flush_job.cc:392] [default] [JOB 3] Level-0 flush table #10: 1991605 bytes OK 2019-12-24T22:00:05.454 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.870+0000 7ff2b1af8700 4 rocksdb: (Original Log Time 2019/12/24-22:00:04.871219) [db/memtable_list.cc:380] [default] Level-0 commit table #10 started 2019-12-24T22:00:05.454 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.870+0000 7ff2b1af8700 4 rocksdb: (Original Log Time 2019/12/24-22:00:04.871359) [db/memtable_list.cc:428] [default] Level-0 commit table #10: memtable #1 done 2019-12-24T22:00:05.454 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.870+0000 7ff2b1af8700 4 rocksdb: (Original Log Time 2019/12/24-22:00:04.871373) EVENT_LOG_v1 {"time_micros": 1577224804871366, "job": 3, "event": "flush_finished", "output_compression": "NoCompression", "lsm_state": [2, 0, 0, 0, 0, 0, 0], "immutable_memtables": 0} 2019-12-24T22:00:05.454 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.870+0000 7ff2b1af8700 4 rocksdb: (Original Log Time 2019/12/24-22:00:04.871387) [db/db_impl_compaction_flush.cc:201] [default] Level summary: files[2 0 0 0 0 0 0] max score 0.50 2019-12-24T22:00:05.454 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.455 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.870+0000 7ff2b1af8700 4 rocksdb: [db/db_impl_files.cc:356] [JOB 3] Try to delete WAL files size 2126689, prev total WAL file size 2830924, number of live WAL files 2. 2019-12-24T22:00:05.455 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.455 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.870+0000 7ff2a7ae4700 4 rocksdb: [db/db_impl_compaction_flush.cc:1403] [default] Manual compaction starting 2019-12-24T22:00:05.455 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.870+0000 7ff2b22f9700 4 rocksdb: (Original Log Time 2019/12/24-22:00:04.871544) [db/db_impl_compaction_flush.cc:2374] [default] Manual compaction from level-0 to level-6 from 'mgrstat .. 'mgrstat; will stop at (end) 2019-12-24T22:00:05.455 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.455 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.870+0000 7ff2b22f9700 4 rocksdb: [db/compaction_job.cc:1645] [default] [JOB 4] Compacting 2@0 files to L6, score -1.00 2019-12-24T22:00:05.456 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.870+0000 7ff2b22f9700 4 rocksdb: [db/compaction_job.cc:1649] [default] Compaction start summary: Base version 3 Base level 0, inputs: [10(1944KB) 4(1524B)] 2019-12-24T22:00:05.456 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.456 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.870+0000 7ff2b22f9700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577224804871648, "job": 4, "event": "compaction_started", "compaction_reason": "ManualCompaction", "files_L0": [10, 4], "score": -1, "input_data_size": 1993129} 2019-12-24T22:00:05.456 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.871+0000 7ff2ac2ed700 0 mon.c@-1(synchronizing).mds e1 new map 2019-12-24T22:00:05.457 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.871+0000 7ff2ac2ed700 0 mon.c@-1(synchronizing).mds e1 print_map 2019-12-24T22:00:05.457 INFO:ceph.mon.c.smithi124.stdout:e1 2019-12-24T22:00:05.457 INFO:ceph.mon.c.smithi124.stdout:enable_multiple, ever_enabled_multiple: 0,0 2019-12-24T22:00:05.457 INFO:ceph.mon.c.smithi124.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2019-12-24T22:00:05.457 INFO:ceph.mon.c.smithi124.stdout:legacy client fscid: -1 2019-12-24T22:00:05.457 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.457 INFO:ceph.mon.c.smithi124.stdout:No filesystems configured 2019-12-24T22:00:05.458 INFO:ceph.mon.c.smithi124.stdout: 2019-12-24T22:00:05.458 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.871+0000 7ff2ac2ed700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2019-12-24T22:00:05.458 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.872+0000 7ff2ac2ed700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2019-12-24T22:00:05.458 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.872+0000 7ff2ac2ed700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2019-12-24T22:00:05.458 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.872+0000 7ff2ac2ed700 0 mon.c@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2019-12-24T22:00:05.458 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.872+0000 7ff2ac2ed700 0 mon.c@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2019-12-24T22:00:05.458 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.872+0000 7ff2ac2ed700 0 mon.c@-1(synchronizing).osd e3 crush map has features 3314932999778484224, adjusting msgr requires 2019-12-24T22:00:05.459 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.872+0000 7ff2ac2ed700 0 mon.c@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2019-12-24T22:00:05.459 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.872+0000 7ff2ac2ed700 1 mon.c@-1(synchronizing).paxosservice(auth 1..7) refresh upgraded, format 0 -> 3 2019-12-24T22:00:05.459 INFO:ceph.mon.c.smithi124.stdout:2019-12-24T22:00:04.875+0000 7ff2ac2ed700 10 mon.c@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete,mon_osdmap_full_prune_interval,mon_osdmap_full_prune_min,mon_osdmap_full_prune_txsize 2019-12-24T22:00:10.311 INFO:teuthology.orchestra.run.smithi124.stdout: 2019-12-24T22:00:10.312 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":3,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","modified":"2019-12-24T22:00:04.879342Z","created":"2019-12-24T21:57:35.728301Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:3300","nonce":0},{"type":"v1","addr":"172.21.15.124:6789","nonce":0}]},"addr":"172.21.15.124:6789/0","public_addr":"172.21.15.124:6789/0","priority":0,"weight":0}],"quorum":[0,1,2]} 2019-12-24T22:00:10.313 INFO:teuthology.orchestra.run.smithi124.stderr:dumped monmap epoch 3 2019-12-24T22:00:10.809 INFO:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator service-instance reconfig mon b 2019-12-24T22:00:13.396 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi124,172.21.15.124' (ECDSA) to the list of known hosts. 2019-12-24T22:00:14.396 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi006,172.21.15.6' (ECDSA) to the list of known hosts. 2019-12-24T22:00:17.096 INFO:teuthology.orchestra.run.smithi006.stdout:["Reconfigured mon.b on host 'smithi006'"] 2019-12-24T22:00:17.619 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator service-instance reconfig mon a 2019-12-24T22:00:20.151 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi006,172.21.15.6' (ECDSA) to the list of known hosts. 2019-12-24T22:00:21.150 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi037,172.21.15.37' (ECDSA) to the list of known hosts. 2019-12-24T22:00:23.920 INFO:teuthology.orchestra.run.smithi037.stdout:["Reconfigured mon.a on host 'smithi037'"] 2019-12-24T22:00:24.500 INFO:teuthology.orchestra.run.smithi124:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator service-instance reconfig mon c 2019-12-24T22:00:26.905 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi037,172.21.15.37' (ECDSA) to the list of known hosts. 2019-12-24T22:00:27.905 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi124,172.21.15.124' (ECDSA) to the list of known hosts. 2019-12-24T22:00:30.697 INFO:teuthology.orchestra.run.smithi124.stdout:["Reconfigured mon.c on host 'smithi124'"] 2019-12-24T22:00:31.187 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator service-instance reconfig mgr y 2019-12-24T22:00:33.658 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi124,172.21.15.124' (ECDSA) to the list of known hosts. 2019-12-24T22:00:34.659 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi037,172.21.15.37' (ECDSA) to the list of known hosts. 2019-12-24T22:00:37.485 INFO:teuthology.orchestra.run.smithi037.stdout:["Reconfigured mgr.y on host 'smithi037'"] 2019-12-24T22:00:38.038 INFO:tasks.cephadm:Adding mgr.x on smithi006 2019-12-24T22:00:38.038 INFO:teuthology.orchestra.run.smithi124:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator mgr update 2 smithi006=x 2019-12-24T22:00:40.415 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi037,172.21.15.37' (ECDSA) to the list of known hosts. 2019-12-24T22:00:41.413 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi006,172.21.15.6' (ECDSA) to the list of known hosts. 2019-12-24T22:00:44.151 INFO:teuthology.orchestra.run.smithi124.stdout:["Deployed mgr.x on host 'smithi006'"] 2019-12-24T22:00:44.675 INFO:teuthology.orchestra.run.smithi006:mgr.x> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 4a02c23c-2698-11ea-8286-001a4aab830c --name mgr.x 2019-12-24T22:00:44.681 INFO:tasks.cephadm:Deploying OSDs... 2019-12-24T22:00:44.805 DEBUG:teuthology.orchestra.remote:smithi006:/scratch_devs is 72B 2019-12-24T22:00:44.871 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-24T22:00:44.871 INFO:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-12-24T22:00:44.922 INFO:teuthology.orchestra.run.smithi006.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-12-24T22:00:44.922 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-24T22:00:44.923 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 109661 Links: 1 2019-12-24T22:00:44.923 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-24T22:00:44.923 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2019-12-24T22:00:44.923 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2019-12-24 22:00:43.557678966 +0000 2019-12-24T22:00:44.923 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2019-12-24 21:53:44.732315892 +0000 2019-12-24T22:00:44.923 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2019-12-24 21:53:44.732315892 +0000 2019-12-24T22:00:44.924 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2019-12-24T22:00:44.938 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2019-12-24T22:00:44.938 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2019-12-24T22:00:44.938 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes (512 B) copied, 0.000287861 s, 1.8 MB/s 2019-12-24T22:00:44.941 INFO:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-12-24T22:00:45.031 INFO:teuthology.orchestra.run.smithi006.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-12-24T22:00:45.032 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-24T22:00:45.032 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 104842 Links: 1 2019-12-24T22:00:45.032 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-24T22:00:45.032 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2019-12-24T22:00:45.032 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2019-12-24 22:00:43.557678966 +0000 2019-12-24T22:00:45.032 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2019-12-24 21:53:45.238310720 +0000 2019-12-24T22:00:45.033 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2019-12-24 21:53:45.238310720 +0000 2019-12-24T22:00:45.033 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2019-12-24T22:00:45.050 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2019-12-24T22:00:45.050 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2019-12-24T22:00:45.050 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes (512 B) copied, 0.000272329 s, 1.9 MB/s 2019-12-24T22:00:45.054 INFO:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-12-24T22:00:45.108 INFO:teuthology.orchestra.run.smithi006.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-12-24T22:00:45.108 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-24T22:00:45.108 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 99049 Links: 1 2019-12-24T22:00:45.108 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-24T22:00:45.109 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2019-12-24T22:00:45.109 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2019-12-24 22:00:43.558678961 +0000 2019-12-24T22:00:45.109 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2019-12-24 21:53:45.731305682 +0000 2019-12-24T22:00:45.109 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2019-12-24 21:53:45.731305682 +0000 2019-12-24T22:00:45.109 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2019-12-24T22:00:45.122 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2019-12-24T22:00:45.122 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2019-12-24T22:00:45.122 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes (512 B) copied, 0.000260041 s, 2.0 MB/s 2019-12-24T22:00:45.125 INFO:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-12-24T22:00:45.169 INFO:teuthology.orchestra.run.smithi006.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-12-24T22:00:45.169 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-24T22:00:45.169 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 109719 Links: 1 2019-12-24T22:00:45.169 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-24T22:00:45.169 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2019-12-24T22:00:45.170 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2019-12-24 22:00:43.558678961 +0000 2019-12-24T22:00:45.170 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2019-12-24 21:53:46.260300276 +0000 2019-12-24T22:00:45.170 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2019-12-24 21:53:46.260300276 +0000 2019-12-24T22:00:45.170 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2019-12-24T22:00:45.185 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2019-12-24T22:00:45.186 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2019-12-24T22:00:45.186 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes (512 B) copied, 0.000274707 s, 1.9 MB/s 2019-12-24T22:00:45.299 DEBUG:teuthology.orchestra.remote:smithi037:/scratch_devs is 72B 2019-12-24T22:00:45.394 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-24T22:00:45.394 INFO:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-12-24T22:00:45.470 INFO:teuthology.orchestra.run.smithi037.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-12-24T22:00:45.471 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-24T22:00:45.471 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 105922 Links: 1 2019-12-24T22:00:45.471 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-24T22:00:45.471 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2019-12-24T22:00:45.471 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2019-12-24 21:57:43.859769441 +0000 2019-12-24T22:00:45.471 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2019-12-24 21:53:43.642712345 +0000 2019-12-24T22:00:45.472 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2019-12-24 21:53:43.642712345 +0000 2019-12-24T22:00:45.472 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2019-12-24T22:00:45.505 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2019-12-24T22:00:45.505 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2019-12-24T22:00:45.506 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes (512 B) copied, 0.000365344 s, 1.4 MB/s 2019-12-24T22:00:45.510 INFO:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-12-24T22:00:45.584 INFO:teuthology.orchestra.run.smithi037.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-12-24T22:00:45.585 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-24T22:00:45.585 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 107904 Links: 1 2019-12-24T22:00:45.585 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-24T22:00:45.585 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2019-12-24T22:00:45.585 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2019-12-24 21:57:43.859769441 +0000 2019-12-24T22:00:45.585 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2019-12-24 21:53:44.129704410 +0000 2019-12-24T22:00:45.586 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2019-12-24 21:53:44.129704410 +0000 2019-12-24T22:00:45.586 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2019-12-24T22:00:45.614 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2019-12-24T22:00:45.614 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2019-12-24T22:00:45.614 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes (512 B) copied, 0.000452157 s, 1.1 MB/s 2019-12-24T22:00:45.620 INFO:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-12-24T22:00:45.706 INFO:teuthology.orchestra.run.smithi037.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-12-24T22:00:45.707 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-24T22:00:45.707 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 104448 Links: 1 2019-12-24T22:00:45.707 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-24T22:00:45.707 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2019-12-24T22:00:45.707 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2019-12-24 21:57:43.859769441 +0000 2019-12-24T22:00:45.707 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2019-12-24 21:53:44.607696622 +0000 2019-12-24T22:00:45.708 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2019-12-24 21:53:44.607696622 +0000 2019-12-24T22:00:45.708 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2019-12-24T22:00:45.740 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2019-12-24T22:00:45.740 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2019-12-24T22:00:45.741 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes (512 B) copied, 0.000452741 s, 1.1 MB/s 2019-12-24T22:00:45.746 INFO:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-12-24T22:00:45.833 INFO:teuthology.orchestra.run.smithi037.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-12-24T22:00:45.834 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-24T22:00:45.834 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 97248 Links: 1 2019-12-24T22:00:45.834 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-24T22:00:45.834 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2019-12-24T22:00:45.835 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2019-12-24 21:57:43.860769429 +0000 2019-12-24T22:00:45.835 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2019-12-24 21:53:45.084688850 +0000 2019-12-24T22:00:45.835 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2019-12-24 21:53:45.084688850 +0000 2019-12-24T22:00:45.835 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2019-12-24T22:00:45.864 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2019-12-24T22:00:45.864 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2019-12-24T22:00:45.864 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes (512 B) copied, 0.000373131 s, 1.4 MB/s 2019-12-24T22:00:46.023 DEBUG:teuthology.orchestra.remote:smithi124:/scratch_devs is 72B 2019-12-24T22:00:46.119 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-24T22:00:46.120 INFO:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-12-24T22:00:46.203 INFO:teuthology.orchestra.run.smithi124.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-12-24T22:00:46.203 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-24T22:00:46.203 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 5h/5d Inode: 103230 Links: 1 2019-12-24T22:00:46.203 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-24T22:00:46.203 INFO:teuthology.orchestra.run.smithi124.stdout:Context: system_u:object_r:device_t:s0 2019-12-24T22:00:46.204 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2019-12-24 22:00:03.954639471 +0000 2019-12-24T22:00:46.204 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2019-12-24 21:53:39.408248294 +0000 2019-12-24T22:00:46.204 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2019-12-24 21:53:39.408248294 +0000 2019-12-24T22:00:46.204 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: - 2019-12-24T22:00:46.243 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2019-12-24T22:00:46.243 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2019-12-24T22:00:46.243 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes (512 B) copied, 0.00102123 s, 501 kB/s 2019-12-24T22:00:46.247 INFO:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-12-24T22:00:46.316 INFO:teuthology.orchestra.run.smithi124.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-12-24T22:00:46.316 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-24T22:00:46.316 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 5h/5d Inode: 89015 Links: 1 2019-12-24T22:00:46.316 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-24T22:00:46.316 INFO:teuthology.orchestra.run.smithi124.stdout:Context: system_u:object_r:device_t:s0 2019-12-24T22:00:46.317 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2019-12-24 22:00:03.954639471 +0000 2019-12-24T22:00:46.317 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2019-12-24 21:53:39.882238797 +0000 2019-12-24T22:00:46.317 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2019-12-24 21:53:39.882238797 +0000 2019-12-24T22:00:46.317 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: - 2019-12-24T22:00:46.343 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2019-12-24T22:00:46.343 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2019-12-24T22:00:46.343 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes (512 B) copied, 0.000389384 s, 1.3 MB/s 2019-12-24T22:00:46.347 INFO:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-12-24T22:00:46.423 INFO:teuthology.orchestra.run.smithi124.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-12-24T22:00:46.423 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-24T22:00:46.423 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 5h/5d Inode: 103275 Links: 1 2019-12-24T22:00:46.424 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-24T22:00:46.424 INFO:teuthology.orchestra.run.smithi124.stdout:Context: system_u:object_r:device_t:s0 2019-12-24T22:00:46.424 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2019-12-24 22:00:03.954639471 +0000 2019-12-24T22:00:46.424 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2019-12-24 21:53:40.351229400 +0000 2019-12-24T22:00:46.424 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2019-12-24 21:53:40.351229400 +0000 2019-12-24T22:00:46.424 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: - 2019-12-24T22:00:46.449 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2019-12-24T22:00:46.449 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2019-12-24T22:00:46.449 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes (512 B) copied, 0.000374693 s, 1.4 MB/s 2019-12-24T22:00:46.454 INFO:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-12-24T22:00:46.517 INFO:teuthology.orchestra.run.smithi124.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-12-24T22:00:46.518 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-24T22:00:46.518 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 5h/5d Inode: 89062 Links: 1 2019-12-24T22:00:46.518 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-24T22:00:46.518 INFO:teuthology.orchestra.run.smithi124.stdout:Context: system_u:object_r:device_t:s0 2019-12-24T22:00:46.518 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2019-12-24 22:00:03.954639471 +0000 2019-12-24T22:00:46.518 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2019-12-24 21:53:40.864219123 +0000 2019-12-24T22:00:46.519 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2019-12-24 21:53:40.864219123 +0000 2019-12-24T22:00:46.519 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: - 2019-12-24T22:00:46.538 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2019-12-24T22:00:46.538 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2019-12-24T22:00:46.539 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes (512 B) copied, 0.000287091 s, 1.8 MB/s 2019-12-24T22:00:46.542 INFO:tasks.cephadm:Deploying osd.0 on smithi037 with /dev/vg_nvme/lv_1... 2019-12-24T22:00:46.542 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2019-12-24T22:00:48.844 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-24T22:00:48.844 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_1 2019-12-24T22:00:48.845 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2019-12-24T22:00:48.845 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2019-12-24T22:00:48.845 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2019-12-24T22:00:48.845 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0180489 s, 581 MB/s 2019-12-24T22:00:48.845 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2019-12-24T22:00:49.436 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator osd create smithi037:/dev/vg_nvme/lv_1 2019-12-24T22:00:51.922 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi037,172.21.15.37' (ECDSA) to the list of known hosts. 2019-12-24T22:00:59.676 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi037,172.21.15.37' (ECDSA) to the list of known hosts. 2019-12-24T22:01:03.179 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi037,172.21.15.37' (ECDSA) to the list of known hosts. 2019-12-24T22:01:05.738 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) on host 'smithi037' 2019-12-24T22:01:06.349 INFO:teuthology.orchestra.run.smithi037:osd.0> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 4a02c23c-2698-11ea-8286-001a4aab830c --name osd.0 2019-12-24T22:01:06.357 INFO:tasks.cephadm:Deploying osd.1 on smithi037 with /dev/vg_nvme/lv_2... 2019-12-24T22:01:06.357 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2019-12-24T22:01:06.711 INFO:ceph.osd.0.smithi037.stderr:Error: no container with name or ID ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 found: no such container 2019-12-24T22:01:08.862 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-24T22:01:08.863 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_2 2019-12-24T22:01:08.863 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2019-12-24T22:01:08.863 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2019-12-24T22:01:08.863 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2019-12-24T22:01:08.863 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0171405 s, 612 MB/s 2019-12-24T22:01:08.863 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2019-12-24T22:01:09.499 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator osd create smithi037:/dev/vg_nvme/lv_2 2019-12-24T22:01:11.933 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi037,172.21.15.37' (ECDSA) to the list of known hosts. 2019-12-24T22:01:19.687 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi037,172.21.15.37' (ECDSA) to the list of known hosts. 2019-12-24T22:01:23.190 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi037,172.21.15.37' (ECDSA) to the list of known hosts. 2019-12-24T22:01:25.843 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) on host 'smithi037' 2019-12-24T22:01:26.471 INFO:teuthology.orchestra.run.smithi037:osd.1> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 4a02c23c-2698-11ea-8286-001a4aab830c --name osd.1 2019-12-24T22:01:26.476 INFO:tasks.cephadm:Deploying osd.2 on smithi037 with /dev/vg_nvme/lv_3... 2019-12-24T22:01:26.477 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2019-12-24T22:01:26.820 INFO:ceph.osd.1.smithi037.stderr:Error: no container with name or ID ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 found: no such container 2019-12-24T22:01:29.232 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-24T22:01:29.232 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_3 2019-12-24T22:01:29.233 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2019-12-24T22:01:29.233 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2019-12-24T22:01:29.233 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2019-12-24T22:01:29.233 INFO:teuthology.orchestra.run.smithi037.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0160554 s, 653 MB/s 2019-12-24T22:01:29.233 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 2019-12-24T22:01:29.233 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2019-12-24T22:01:29.849 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator osd create smithi037:/dev/vg_nvme/lv_3 2019-12-24T22:01:32.196 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi037,172.21.15.37' (ECDSA) to the list of known hosts. 2019-12-24T22:01:40.202 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi037,172.21.15.37' (ECDSA) to the list of known hosts. 2019-12-24T22:01:43.704 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi037,172.21.15.37' (ECDSA) to the list of known hosts. 2019-12-24T22:01:46.049 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) on host 'smithi037' 2019-12-24T22:01:46.834 INFO:teuthology.orchestra.run.smithi037:osd.2> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 4a02c23c-2698-11ea-8286-001a4aab830c --name osd.2 2019-12-24T22:01:46.838 INFO:tasks.cephadm:Deploying osd.3 on smithi037 with /dev/vg_nvme/lv_4... 2019-12-24T22:01:46.839 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2019-12-24T22:01:47.136 INFO:ceph.osd.2.smithi037.stderr:Error: no container with name or ID ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 found: no such container 2019-12-24T22:01:49.486 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-24T22:01:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_4 2019-12-24T22:01:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2019-12-24T22:01:49.486 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2019-12-24T22:01:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2019-12-24T22:01:49.487 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0199312 s, 526 MB/s 2019-12-24T22:01:49.487 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2019-12-24T22:01:50.092 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator osd create smithi037:/dev/vg_nvme/lv_4 2019-12-24T22:01:52.710 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi037,172.21.15.37' (ECDSA) to the list of known hosts. 2019-12-24T22:02:00.715 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi037,172.21.15.37' (ECDSA) to the list of known hosts. 2019-12-24T22:02:03.966 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi037,172.21.15.37' (ECDSA) to the list of known hosts. 2019-12-24T22:02:06.454 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) on host 'smithi037' 2019-12-24T22:02:07.183 INFO:teuthology.orchestra.run.smithi037:osd.3> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 4a02c23c-2698-11ea-8286-001a4aab830c --name osd.3 2019-12-24T22:02:07.187 INFO:tasks.cephadm:Deploying osd.4 on smithi006 with /dev/vg_nvme/lv_1... 2019-12-24T22:02:07.188 INFO:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2019-12-24T22:02:07.813 INFO:ceph.osd.3.smithi037.stderr:Error: no container with name or ID ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 found: no such container 2019-12-24T22:02:09.441 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-24T22:02:09.441 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping: /dev/vg_nvme/lv_1 2019-12-24T22:02:09.441 INFO:teuthology.orchestra.run.smithi006.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2019-12-24T22:02:09.442 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10+0 records in 2019-12-24T22:02:09.442 INFO:teuthology.orchestra.run.smithi006.stderr:10+0 records out 2019-12-24T22:02:09.442 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0151777 s, 691 MB/s 2019-12-24T22:02:09.442 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping successful for: 2019-12-24T22:02:09.990 INFO:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator osd create smithi006:/dev/vg_nvme/lv_1 2019-12-24T22:02:12.473 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi006,172.21.15.6' (ECDSA) to the list of known hosts. 2019-12-24T22:02:20.225 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi006,172.21.15.6' (ECDSA) to the list of known hosts. 2019-12-24T22:02:23.476 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi006,172.21.15.6' (ECDSA) to the list of known hosts. 2019-12-24T22:02:26.213 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) on host 'smithi006' 2019-12-24T22:02:26.869 INFO:teuthology.orchestra.run.smithi006:osd.4> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 4a02c23c-2698-11ea-8286-001a4aab830c --name osd.4 2019-12-24T22:02:26.877 INFO:tasks.cephadm:Deploying osd.5 on smithi006 with /dev/vg_nvme/lv_2... 2019-12-24T22:02:26.877 INFO:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2019-12-24T22:02:27.320 INFO:ceph.osd.4.smithi006.stderr:Error: no container with name or ID ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 found: no such container 2019-12-24T22:02:29.576 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-24T22:02:29.576 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping: /dev/vg_nvme/lv_2 2019-12-24T22:02:29.577 INFO:teuthology.orchestra.run.smithi006.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2019-12-24T22:02:29.577 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10+0 records in 2019-12-24T22:02:29.577 INFO:teuthology.orchestra.run.smithi006.stderr:10+0 records out 2019-12-24T22:02:29.577 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0202877 s, 517 MB/s 2019-12-24T22:02:29.577 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping successful for: 2019-12-24T22:02:30.140 INFO:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator osd create smithi006:/dev/vg_nvme/lv_2 2019-12-24T22:02:32.733 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi006,172.21.15.6' (ECDSA) to the list of known hosts. 2019-12-24T22:02:40.487 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi006,172.21.15.6' (ECDSA) to the list of known hosts. 2019-12-24T22:02:43.989 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi006,172.21.15.6' (ECDSA) to the list of known hosts. 2019-12-24T22:02:46.507 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) on host 'smithi006' 2019-12-24T22:02:47.133 INFO:teuthology.orchestra.run.smithi006:osd.5> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 4a02c23c-2698-11ea-8286-001a4aab830c --name osd.5 2019-12-24T22:02:47.137 INFO:tasks.cephadm:Deploying osd.6 on smithi006 with /dev/vg_nvme/lv_3... 2019-12-24T22:02:47.138 INFO:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2019-12-24T22:02:47.671 INFO:ceph.osd.5.smithi006.stderr:Error: no container with name or ID ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 found: no such container 2019-12-24T22:02:50.049 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-24T22:02:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping: /dev/vg_nvme/lv_3 2019-12-24T22:02:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2019-12-24T22:02:50.050 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10+0 records in 2019-12-24T22:02:50.050 INFO:teuthology.orchestra.run.smithi006.stderr:10+0 records out 2019-12-24T22:02:50.050 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0180935 s, 580 MB/s 2019-12-24T22:02:50.050 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping successful for: 2019-12-24T22:02:50.690 INFO:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator osd create smithi006:/dev/vg_nvme/lv_3 2019-12-24T22:02:53.245 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi006,172.21.15.6' (ECDSA) to the list of known hosts. 2019-12-24T22:03:01.000 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi006,172.21.15.6' (ECDSA) to the list of known hosts. 2019-12-24T22:03:04.504 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi006,172.21.15.6' (ECDSA) to the list of known hosts. 2019-12-24T22:03:07.014 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) on host 'smithi006' 2019-12-24T22:03:07.738 INFO:teuthology.orchestra.run.smithi006:osd.6> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 4a02c23c-2698-11ea-8286-001a4aab830c --name osd.6 2019-12-24T22:03:07.743 INFO:tasks.cephadm:Deploying osd.7 on smithi006 with /dev/vg_nvme/lv_4... 2019-12-24T22:03:07.743 INFO:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2019-12-24T22:03:08.197 INFO:ceph.osd.6.smithi006.stderr:Error: no container with name or ID ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 found: no such container 2019-12-24T22:03:10.440 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-24T22:03:10.440 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping: /dev/vg_nvme/lv_4 2019-12-24T22:03:10.440 INFO:teuthology.orchestra.run.smithi006.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2019-12-24T22:03:10.440 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10+0 records in 2019-12-24T22:03:10.441 INFO:teuthology.orchestra.run.smithi006.stderr:10+0 records out 2019-12-24T22:03:10.441 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0212396 s, 494 MB/s 2019-12-24T22:03:10.441 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping successful for: 2019-12-24T22:03:11.087 INFO:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator osd create smithi006:/dev/vg_nvme/lv_4 2019-12-24T22:03:13.508 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi006,172.21.15.6' (ECDSA) to the list of known hosts. 2019-12-24T22:03:21.773 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi006,172.21.15.6' (ECDSA) to the list of known hosts. 2019-12-24T22:03:25.014 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi006,172.21.15.6' (ECDSA) to the list of known hosts. 2019-12-24T22:03:27.441 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) on host 'smithi006' 2019-12-24T22:03:28.172 INFO:teuthology.orchestra.run.smithi006:osd.7> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 4a02c23c-2698-11ea-8286-001a4aab830c --name osd.7 2019-12-24T22:03:28.177 INFO:tasks.cephadm:Deploying osd.8 on smithi124 with /dev/vg_nvme/lv_1... 2019-12-24T22:03:28.178 INFO:teuthology.orchestra.run.smithi124:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2019-12-24T22:03:28.452 INFO:ceph.osd.7.smithi006.stderr:Error: no container with name or ID ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 found: no such container 2019-12-24T22:03:30.487 INFO:teuthology.orchestra.run.smithi124.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-24T22:03:30.487 INFO:teuthology.orchestra.run.smithi124.stderr:--> Zapping: /dev/vg_nvme/lv_1 2019-12-24T22:03:30.487 INFO:teuthology.orchestra.run.smithi124.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2019-12-24T22:03:30.487 INFO:teuthology.orchestra.run.smithi124.stderr: stderr: 10+0 records in 2019-12-24T22:03:30.488 INFO:teuthology.orchestra.run.smithi124.stderr:10+0 records out 2019-12-24T22:03:30.488 INFO:teuthology.orchestra.run.smithi124.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0190426 s, 551 MB/s 2019-12-24T22:03:30.488 INFO:teuthology.orchestra.run.smithi124.stderr:--> Zapping successful for: 2019-12-24T22:03:31.151 INFO:teuthology.orchestra.run.smithi124:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator osd create smithi124:/dev/vg_nvme/lv_1 2019-12-24T22:03:33.521 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi124,172.21.15.124' (ECDSA) to the list of known hosts. 2019-12-24T22:03:41.274 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi124,172.21.15.124' (ECDSA) to the list of known hosts. 2019-12-24T22:03:44.776 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi124,172.21.15.124' (ECDSA) to the list of known hosts. 2019-12-24T22:03:47.368 INFO:teuthology.orchestra.run.smithi124.stdout:Created osd(s) on host 'smithi124' 2019-12-24T22:03:48.013 INFO:teuthology.orchestra.run.smithi124:osd.8> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 4a02c23c-2698-11ea-8286-001a4aab830c --name osd.8 2019-12-24T22:03:48.018 INFO:tasks.cephadm:Deploying osd.9 on smithi124 with /dev/vg_nvme/lv_2... 2019-12-24T22:03:48.018 INFO:teuthology.orchestra.run.smithi124:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2019-12-24T22:03:48.448 INFO:ceph.osd.8.smithi124.stderr:Error: no container with name or ID ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 found: no such container 2019-12-24T22:03:50.632 INFO:teuthology.orchestra.run.smithi124.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-24T22:03:50.632 INFO:teuthology.orchestra.run.smithi124.stderr:--> Zapping: /dev/vg_nvme/lv_2 2019-12-24T22:03:50.632 INFO:teuthology.orchestra.run.smithi124.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2019-12-24T22:03:50.633 INFO:teuthology.orchestra.run.smithi124.stderr: stderr: 10+0 records in 2019-12-24T22:03:50.633 INFO:teuthology.orchestra.run.smithi124.stderr:10+0 records out 2019-12-24T22:03:50.633 INFO:teuthology.orchestra.run.smithi124.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0202295 s, 518 MB/s 2019-12-24T22:03:50.633 INFO:teuthology.orchestra.run.smithi124.stderr:--> Zapping successful for: 2019-12-24T22:03:51.206 INFO:teuthology.orchestra.run.smithi124:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator osd create smithi124:/dev/vg_nvme/lv_2 2019-12-24T22:03:53.531 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi124,172.21.15.124' (ECDSA) to the list of known hosts. 2019-12-24T22:04:01.285 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi124,172.21.15.124' (ECDSA) to the list of known hosts. 2019-12-24T22:04:04.787 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi124,172.21.15.124' (ECDSA) to the list of known hosts. 2019-12-24T22:04:07.384 INFO:teuthology.orchestra.run.smithi124.stdout:Created osd(s) on host 'smithi124' 2019-12-24T22:04:08.031 INFO:teuthology.orchestra.run.smithi124:osd.9> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 4a02c23c-2698-11ea-8286-001a4aab830c --name osd.9 2019-12-24T22:04:08.037 INFO:tasks.cephadm:Deploying osd.10 on smithi124 with /dev/vg_nvme/lv_3... 2019-12-24T22:04:08.037 INFO:teuthology.orchestra.run.smithi124:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2019-12-24T22:04:08.438 INFO:ceph.osd.9.smithi124.stderr:Error: no container with name or ID ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.9 found: no such container 2019-12-24T22:04:10.605 INFO:teuthology.orchestra.run.smithi124.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-24T22:04:10.605 INFO:teuthology.orchestra.run.smithi124.stderr:--> Zapping: /dev/vg_nvme/lv_3 2019-12-24T22:04:10.605 INFO:teuthology.orchestra.run.smithi124.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2019-12-24T22:04:10.605 INFO:teuthology.orchestra.run.smithi124.stderr: stderr: 10+0 records in 2019-12-24T22:04:10.605 INFO:teuthology.orchestra.run.smithi124.stderr:10+0 records out 2019-12-24T22:04:10.605 INFO:teuthology.orchestra.run.smithi124.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0203494 s, 515 MB/s 2019-12-24T22:04:10.606 INFO:teuthology.orchestra.run.smithi124.stderr:--> Zapping successful for: 2019-12-24T22:04:11.171 INFO:teuthology.orchestra.run.smithi124:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator osd create smithi124:/dev/vg_nvme/lv_3 2019-12-24T22:04:13.543 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi124,172.21.15.124' (ECDSA) to the list of known hosts. 2019-12-24T22:04:21.297 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi124,172.21.15.124' (ECDSA) to the list of known hosts. 2019-12-24T22:04:24.800 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi124,172.21.15.124' (ECDSA) to the list of known hosts. 2019-12-24T22:04:27.332 INFO:teuthology.orchestra.run.smithi124.stdout:Created osd(s) on host 'smithi124' 2019-12-24T22:04:28.030 INFO:teuthology.orchestra.run.smithi124:osd.10> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 4a02c23c-2698-11ea-8286-001a4aab830c --name osd.10 2019-12-24T22:04:28.036 INFO:tasks.cephadm:Deploying osd.11 on smithi124 with /dev/vg_nvme/lv_4... 2019-12-24T22:04:28.036 INFO:teuthology.orchestra.run.smithi124:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2019-12-24T22:04:28.455 INFO:ceph.osd.10.smithi124.stderr:Error: no container with name or ID ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 found: no such container 2019-12-24T22:04:30.750 INFO:teuthology.orchestra.run.smithi124.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-24T22:04:30.750 INFO:teuthology.orchestra.run.smithi124.stderr:--> Zapping: /dev/vg_nvme/lv_4 2019-12-24T22:04:30.750 INFO:teuthology.orchestra.run.smithi124.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2019-12-24T22:04:30.751 INFO:teuthology.orchestra.run.smithi124.stderr: stderr: 10+0 records in 2019-12-24T22:04:30.751 INFO:teuthology.orchestra.run.smithi124.stderr:10+0 records out 2019-12-24T22:04:30.751 INFO:teuthology.orchestra.run.smithi124.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0175232 s, 598 MB/s 2019-12-24T22:04:30.751 INFO:teuthology.orchestra.run.smithi124.stderr:--> Zapping successful for: 2019-12-24T22:04:31.329 INFO:teuthology.orchestra.run.smithi124:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph orchestrator osd create smithi124:/dev/vg_nvme/lv_4 2019-12-24T22:04:33.805 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi124,172.21.15.124' (ECDSA) to the list of known hosts. 2019-12-24T22:04:41.815 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi124,172.21.15.124' (ECDSA) to the list of known hosts. 2019-12-24T22:04:45.313 INFO:ceph.mgr.y.smithi037.stdout:Warning: Permanently added 'smithi124,172.21.15.124' (ECDSA) to the list of known hosts. 2019-12-24T22:04:47.685 INFO:teuthology.orchestra.run.smithi124.stdout:Created osd(s) on host 'smithi124' 2019-12-24T22:04:48.387 INFO:teuthology.orchestra.run.smithi124:osd.11> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 4a02c23c-2698-11ea-8286-001a4aab830c --name osd.11 2019-12-24T22:04:48.393 INFO:tasks.cephadm:Setting up client nodes... 2019-12-24T22:04:48.393 INFO:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2019-12-24T22:04:48.745 INFO:ceph.osd.11.smithi124.stderr:Error: no container with name or ID ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 found: no such container 2019-12-24T22:04:50.841 INFO:teuthology.orchestra.run.smithi006.stdout:[client.1] 2019-12-24T22:04:50.842 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCCiwJeK3r8MRAAYF/7Yarr9/0SWdATzk79dA== 2019-12-24T22:04:51.353 INFO:teuthology.orchestra.run.smithi006:> sudo sh -c 'cat > /etc/ceph/ceph.client.1.keyring' && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2019-12-24T22:04:51.564 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2019-12-24T22:04:53.921 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2019-12-24T22:04:53.921 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCFiwJeEC2tNhAAw0mbhhRxIXDIz2bCOfryjQ== 2019-12-24T22:04:54.535 INFO:teuthology.orchestra.run.smithi037:> sudo sh -c 'cat > /etc/ceph/ceph.client.0.keyring' && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2019-12-24T22:04:54.729 INFO:teuthology.orchestra.run.smithi124:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph auth get-or-create client.2 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2019-12-24T22:04:57.170 INFO:teuthology.orchestra.run.smithi124.stdout:[client.2] 2019-12-24T22:04:57.170 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQCJiwJeBJv8CRAAXIcEOGBI9ldlYXKBIPoSGA== 2019-12-24T22:04:57.749 INFO:teuthology.orchestra.run.smithi124:> sudo sh -c 'cat > /etc/ceph/ceph.client.2.keyring' && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2019-12-24T22:04:57.940 INFO:tasks.cephadm:Distributing config and client.admin keyring... 2019-12-24T22:04:57.940 INFO:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph 2019-12-24T22:04:58.067 INFO:teuthology.orchestra.run.smithi006:> sudo sh -c 'cat > /etc/ceph/ceph.conf' 2019-12-24T22:04:58.170 INFO:teuthology.orchestra.run.smithi006:> sudo sh -c 'cat > /etc/ceph/ceph.client.admin.keyring' 2019-12-24T22:04:58.253 INFO:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph 2019-12-24T22:04:58.384 INFO:teuthology.orchestra.run.smithi037:> sudo sh -c 'cat > /etc/ceph/ceph.conf' 2019-12-24T22:04:58.494 INFO:teuthology.orchestra.run.smithi037:> sudo sh -c 'cat > /etc/ceph/ceph.client.admin.keyring' 2019-12-24T22:04:58.592 INFO:teuthology.orchestra.run.smithi124:> sudo mkdir -p /etc/ceph 2019-12-24T22:04:58.721 INFO:teuthology.orchestra.run.smithi124:> sudo sh -c 'cat > /etc/ceph/ceph.conf' 2019-12-24T22:04:58.827 INFO:teuthology.orchestra.run.smithi124:> sudo sh -c 'cat > /etc/ceph/ceph.client.admin.keyring' 2019-12-24T22:04:58.909 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:05:01.301 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:05:01.301 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":64,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:04:54.133559+0000","last_up_change":"2019-12-24T22:04:53.120071+0000","last_in_change":"2019-12-24T22:04:53.120071+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists","up"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:10.523358+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:30.849326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:51.599747+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:11.648821+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:31.154626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:51.401265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:11.329709+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:32.391713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:52.180247+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:11.164816+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:31.202339+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:51.355887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:05:01.935 INFO:tasks.cephadm.ceph_manager.ceph:[] 2019-12-24T22:05:01.935 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2019-12-24T22:05:01.935 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2019-12-24T22:05:01.935 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph mgr dump --format=json 2019-12-24T22:05:04.175 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:05:04.871 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":11,"active_gid":14120,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1},{"type":"v1","addr":"172.21.15.37:6801","nonce":1}]},"active_addr":"172.21.15.37:6801/1","active_change":"2019-12-24T21:58:09.007767+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":24103,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"1","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"str","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"str","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["ansible","cephadm","deepsea","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"1","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"str","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"str","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["ansible","cephadm","deepsea","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi037.front.sepia.ceph.com:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":3,"active_clients":[]}} 2019-12-24T22:05:04.876 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2019-12-24T22:05:04.876 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2019-12-24T22:05:04.877 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:05:07.191 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:05:07.191 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":64,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:04:54.133559+0000","last_up_change":"2019-12-24T22:04:53.120071+0000","last_in_change":"2019-12-24T22:04:53.120071+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists","up"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:10.523358+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:30.849326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:51.599747+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:11.648821+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:31.154626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:51.401265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:11.329709+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:32.391713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:52.180247+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:11.164816+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:31.202339+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:51.355887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:05:07.798 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2019-12-24T22:05:07.798 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:05:10.054 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:05:10.054 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":64,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:04:54.133559+0000","last_up_change":"2019-12-24T22:04:53.120071+0000","last_in_change":"2019-12-24T22:04:53.120071+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists","up"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:10.523358+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:30.849326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:51.599747+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:11.648821+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:31.154626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:51.401265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:11.329709+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:32.391713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:52.180247+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:11.164816+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:31.202339+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:04:51.355887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:05:10.606 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2019-12-24T22:05:13.247 INFO:teuthology.orchestra.run.smithi037.stdout:30064771124 2019-12-24T22:05:13.247 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2019-12-24T22:05:15.845 INFO:teuthology.orchestra.run.smithi037.stdout:51539607600 2019-12-24T22:05:15.845 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2019-12-24T22:05:18.552 INFO:teuthology.orchestra.run.smithi037.stdout:73014444076 2019-12-24T22:05:18.552 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2019-12-24T22:05:21.210 INFO:teuthology.orchestra.run.smithi037.stdout:94489280552 2019-12-24T22:05:21.210 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2019-12-24T22:05:23.912 INFO:teuthology.orchestra.run.smithi037.stdout:115964117030 2019-12-24T22:05:23.913 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2019-12-24T22:05:26.612 INFO:teuthology.orchestra.run.smithi037.stdout:137438953506 2019-12-24T22:05:26.613 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2019-12-24T22:05:29.229 INFO:teuthology.orchestra.run.smithi037.stdout:163208757278 2019-12-24T22:05:29.229 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2019-12-24T22:05:31.824 INFO:teuthology.orchestra.run.smithi037.stdout:184683593755 2019-12-24T22:05:31.824 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph tell osd.8 flush_pg_stats 2019-12-24T22:05:34.521 INFO:teuthology.orchestra.run.smithi037.stdout:206158430231 2019-12-24T22:05:34.522 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph tell osd.9 flush_pg_stats 2019-12-24T22:05:37.189 INFO:teuthology.orchestra.run.smithi037.stdout:227633266707 2019-12-24T22:05:37.189 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph tell osd.10 flush_pg_stats 2019-12-24T22:05:39.730 INFO:teuthology.orchestra.run.smithi037.stdout:249108103185 2019-12-24T22:05:39.730 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph tell osd.11 flush_pg_stats 2019-12-24T22:05:42.450 INFO:teuthology.orchestra.run.smithi037.stdout:270582939661 2019-12-24T22:05:42.451 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd last-stat-seq osd.0 2019-12-24T22:05:44.729 INFO:teuthology.orchestra.run.smithi037.stdout:30064771130 2019-12-24T22:05:45.251 INFO:tasks.cephadm.ceph_manager.ceph:need seq 30064771124 got 30064771130 for osd.0 2019-12-24T22:05:45.251 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd last-stat-seq osd.1 2019-12-24T22:05:47.479 INFO:teuthology.orchestra.run.smithi037.stdout:51539607606 2019-12-24T22:05:47.991 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607600 got 51539607606 for osd.1 2019-12-24T22:05:47.992 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd last-stat-seq osd.2 2019-12-24T22:05:50.251 INFO:teuthology.orchestra.run.smithi037.stdout:73014444082 2019-12-24T22:05:50.774 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444076 got 73014444082 for osd.2 2019-12-24T22:05:50.775 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd last-stat-seq osd.3 2019-12-24T22:05:53.014 INFO:teuthology.orchestra.run.smithi037.stdout:94489280558 2019-12-24T22:05:53.557 INFO:tasks.cephadm.ceph_manager.ceph:need seq 94489280552 got 94489280558 for osd.3 2019-12-24T22:05:53.558 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd last-stat-seq osd.4 2019-12-24T22:05:55.790 INFO:teuthology.orchestra.run.smithi037.stdout:115964117036 2019-12-24T22:05:56.353 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117030 got 115964117036 for osd.4 2019-12-24T22:05:56.353 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd last-stat-seq osd.5 2019-12-24T22:05:58.612 INFO:teuthology.orchestra.run.smithi037.stdout:137438953512 2019-12-24T22:05:59.170 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953506 got 137438953512 for osd.5 2019-12-24T22:05:59.170 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd last-stat-seq osd.6 2019-12-24T22:06:01.413 INFO:teuthology.orchestra.run.smithi037.stdout:163208757285 2019-12-24T22:06:01.978 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757278 got 163208757285 for osd.6 2019-12-24T22:06:01.978 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd last-stat-seq osd.7 2019-12-24T22:06:04.203 INFO:teuthology.orchestra.run.smithi037.stdout:184683593761 2019-12-24T22:06:04.736 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593755 got 184683593761 for osd.7 2019-12-24T22:06:04.736 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd last-stat-seq osd.8 2019-12-24T22:06:07.021 INFO:teuthology.orchestra.run.smithi037.stdout:206158430238 2019-12-24T22:06:07.580 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430231 got 206158430238 for osd.8 2019-12-24T22:06:07.580 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd last-stat-seq osd.9 2019-12-24T22:06:09.808 INFO:teuthology.orchestra.run.smithi037.stdout:227633266713 2019-12-24T22:06:10.324 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266707 got 227633266713 for osd.9 2019-12-24T22:06:10.324 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd last-stat-seq osd.10 2019-12-24T22:06:12.656 INFO:teuthology.orchestra.run.smithi037.stdout:249108103191 2019-12-24T22:06:13.199 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103185 got 249108103191 for osd.10 2019-12-24T22:06:13.199 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd last-stat-seq osd.11 2019-12-24T22:06:15.472 INFO:teuthology.orchestra.run.smithi037.stdout:270582939667 2019-12-24T22:06:16.060 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939661 got 270582939667 for osd.11 2019-12-24T22:06:16.061 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2019-12-24T22:06:16.061 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph pg dump --format=json 2019-12-24T22:06:18.344 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:06:18.345 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2019-12-24T22:06:18.934 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2019-12-24T22:06:18.082234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":12,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1124941824,"kb_used":12590784,"kb_used_data":7776,"kb_used_omap":0,"kb_used_meta":12582912,"kb_avail":1112351040,"statfs":{"total":1151940427776,"available":1139047464960,"internally_reserved":12884901888,"allocated":7962624,"data_stored":3782472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12884901888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":11,"up_from":63,"seq":270582939668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.035,"5min":1.035,"15min":1.035},"min":{"1min":0.457,"5min":0.457,"15min":0.457},"max":{"1min":1.790,"5min":1.790,"15min":1.790},"last":1.164},{"interface":"front","average":{"1min":1.035,"5min":1.035,"15min":1.035},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.908,"5min":1.908,"15min":1.908},"last":1.750}]},{"osd":1,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.043,"5min":1.043,"15min":1.043},"min":{"1min":0.559,"5min":0.559,"15min":0.559},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":1.347},{"interface":"front","average":{"1min":0.920,"5min":0.920,"15min":0.920},"min":{"1min":0.591,"5min":0.591,"15min":0.591},"max":{"1min":1.539,"5min":1.539,"15min":1.539},"last":1.480}]},{"osd":2,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.946,"5min":0.946,"15min":0.946},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.059,"5min":2.059,"15min":2.059},"last":1.000},{"interface":"front","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.673,"5min":0.673,"15min":0.673},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.303}]},{"osd":3,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.140,"5min":1.140,"15min":1.140},"min":{"1min":0.518,"5min":0.518,"15min":0.518},"max":{"1min":2.138,"5min":2.138,"15min":2.138},"last":0.935},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.659,"5min":0.659,"15min":0.659},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.062}]},{"osd":4,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.965,"5min":0.965,"15min":0.965},"max":{"1min":2.013,"5min":2.013,"15min":2.013},"last":0.759},{"interface":"front","average":{"1min":1.260,"5min":1.260,"15min":1.260},"min":{"1min":0.786,"5min":0.786,"15min":0.786},"max":{"1min":2.197,"5min":2.197,"15min":2.197},"last":1.580}]},{"osd":5,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.533,"5min":1.533,"15min":1.533},"min":{"1min":1.098,"5min":1.098,"15min":1.098},"max":{"1min":2.455,"5min":2.455,"15min":2.455},"last":1.711},{"interface":"front","average":{"1min":1.350,"5min":1.350,"15min":1.350},"min":{"1min":0.674,"5min":0.674,"15min":0.674},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.446}]},{"osd":6,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.362,"5min":1.362,"15min":1.362},"min":{"1min":0.883,"5min":0.883,"15min":0.883},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.937},{"interface":"front","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":1.289,"5min":1.289,"15min":1.289},"max":{"1min":2.778,"5min":2.778,"15min":2.778},"last":1.544}]},{"osd":7,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":1.112,"5min":1.112,"15min":1.112},"max":{"1min":2.337,"5min":2.337,"15min":2.337},"last":1.858},{"interface":"front","average":{"1min":1.640,"5min":1.640,"15min":1.640},"min":{"1min":1.169,"5min":1.169,"15min":1.169},"max":{"1min":2.897,"5min":2.897,"15min":2.897},"last":1.646}]},{"osd":8,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.432,"5min":1.432,"15min":1.432},"min":{"1min":0.849,"5min":0.849,"15min":0.849},"max":{"1min":1.834,"5min":1.834,"15min":1.834},"last":1.202},{"interface":"front","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":1.076,"5min":1.076,"15min":1.076},"max":{"1min":3.173,"5min":3.173,"15min":3.173},"last":1.237}]},{"osd":10,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.461,"5min":1.461,"15min":1.461},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":1.808,"5min":1.808,"15min":1.808},"last":1.517},{"interface":"front","average":{"1min":1.701,"5min":1.701,"15min":1.701},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.985,"5min":2.985,"15min":2.985},"last":2.015}]}]},{"osd":10,"up_from":58,"seq":249108103192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.804}]},{"osd":1,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":0.965,"5min":0.965,"15min":0.965},"min":{"1min":0.573,"5min":0.573,"15min":0.573},"max":{"1min":1.612,"5min":1.612,"15min":1.612},"last":0.933},{"interface":"front","average":{"1min":0.963,"5min":0.963,"15min":0.963},"min":{"1min":0.612,"5min":0.612,"15min":0.612},"max":{"1min":1.410,"5min":1.410,"15min":1.410},"last":0.667}]},{"osd":2,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":0.985,"5min":0.985,"15min":0.985},"min":{"1min":0.575,"5min":0.575,"15min":0.575},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.734},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.645,"5min":0.645,"15min":0.645},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.187}]},{"osd":3,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.358,"5min":1.358,"15min":1.358},"min":{"1min":0.579,"5min":0.579,"15min":0.579},"max":{"1min":8.538,"5min":8.538,"15min":8.538},"last":0.814},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.655,"5min":0.655,"15min":0.655},"max":{"1min":8.477,"5min":8.477,"15min":8.477},"last":1.080}]},{"osd":4,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.328,"5min":1.328,"15min":1.328},"min":{"1min":0.802,"5min":0.802,"15min":0.802},"max":{"1min":1.815,"5min":1.815,"15min":1.815},"last":1.413},{"interface":"front","average":{"1min":1.350,"5min":1.350,"15min":1.350},"min":{"1min":0.882,"5min":0.882,"15min":0.882},"max":{"1min":1.880,"5min":1.880,"15min":1.880},"last":1.283}]},{"osd":5,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.382,"5min":1.382,"15min":1.382},"min":{"1min":0.848,"5min":0.848,"15min":0.848},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":1.508},{"interface":"front","average":{"1min":1.396,"5min":1.396,"15min":1.396},"min":{"1min":0.980,"5min":0.980,"15min":0.980},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.541}]},{"osd":6,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.750,"5min":0.750,"15min":0.750},"max":{"1min":2.063,"5min":2.063,"15min":2.063},"last":1.325},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.838,"5min":0.838,"15min":0.838},"max":{"1min":2.025,"5min":2.025,"15min":2.025},"last":1.580}]},{"osd":7,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.279,"5min":2.279,"15min":2.279},"last":1.031},{"interface":"front","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":1.224,"5min":1.224,"15min":1.224},"max":{"1min":2.125,"5min":2.125,"15min":2.125},"last":1.449}]},{"osd":8,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.558,"5min":1.558,"15min":1.558},"min":{"1min":0.888,"5min":0.888,"15min":0.888},"max":{"1min":2.178,"5min":2.178,"15min":2.178},"last":1.368},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.757,"5min":0.757,"15min":0.757},"max":{"1min":2.007,"5min":2.007,"15min":2.007},"last":1.663}]},{"osd":9,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.578,"5min":1.578,"15min":1.578},"min":{"1min":0.616,"5min":0.616,"15min":0.616},"max":{"1min":2.446,"5min":2.446,"15min":2.446},"last":1.635},{"interface":"front","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.566,"5min":0.566,"15min":0.566},"max":{"1min":2.193,"5min":2.193,"15min":2.193},"last":1.741}]},{"osd":11,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.738,"5min":1.738,"15min":1.738},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.775},{"interface":"front","average":{"1min":1.588,"5min":1.588,"15min":1.588},"min":{"1min":1.143,"5min":1.143,"15min":1.143},"max":{"1min":2.123,"5min":2.123,"15min":2.123},"last":1.714}]}]},{"osd":9,"up_from":53,"seq":227633266715,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049224,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695928,"statfs":{"total":95995035648,"available":94920630272,"internally_reserved":1073741824,"allocated":655360,"data_stored":310694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:14 2019","interfaces":[{"interface":"back","average":{"1min":0.923,"5min":0.923,"15min":0.923},"min":{"1min":0.475,"5min":0.475,"15min":0.475},"max":{"1min":1.602,"5min":1.602,"15min":1.602},"last":1.299},{"interface":"front","average":{"1min":0.885,"5min":0.885,"15min":0.885},"min":{"1min":0.484,"5min":0.484,"15min":0.484},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":1.002}]},{"osd":1,"last update":"Tue Dec 24 22:05:14 2019","interfaces":[{"interface":"back","average":{"1min":0.838,"5min":0.838,"15min":0.838},"min":{"1min":0.597,"5min":0.597,"15min":0.597},"max":{"1min":1.660,"5min":1.660,"15min":1.660},"last":0.838},{"interface":"front","average":{"1min":1.092,"5min":1.092,"15min":1.092},"min":{"1min":0.674,"5min":0.674,"15min":0.674},"max":{"1min":1.559,"5min":1.559,"15min":1.559},"last":0.785}]},{"osd":2,"last update":"Tue Dec 24 22:05:14 2019","interfaces":[{"interface":"back","average":{"1min":1.050,"5min":1.050,"15min":1.050},"min":{"1min":0.536,"5min":0.536,"15min":0.536},"max":{"1min":1.500,"5min":1.500,"15min":1.500},"last":0.943},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.822,"5min":0.822,"15min":0.822},"max":{"1min":1.608,"5min":1.608,"15min":1.608},"last":0.906}]},{"osd":3,"last update":"Tue Dec 24 22:05:14 2019","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.976,"5min":0.976,"15min":0.976},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.494},{"interface":"front","average":{"1min":1.112,"5min":1.112,"15min":1.112},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.535,"5min":1.535,"15min":1.535},"last":1.431}]},{"osd":4,"last update":"Tue Dec 24 22:05:14 2019","interfaces":[{"interface":"back","average":{"1min":0.921,"5min":0.921,"15min":0.921},"min":{"1min":0.484,"5min":0.484,"15min":0.484},"max":{"1min":1.453,"5min":1.453,"15min":1.453},"last":1.045},{"interface":"front","average":{"1min":1.316,"5min":1.316,"15min":1.316},"min":{"1min":0.803,"5min":0.803,"15min":0.803},"max":{"1min":1.680,"5min":1.680,"15min":1.680},"last":1.589}]},{"osd":5,"last update":"Tue Dec 24 22:05:14 2019","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.781,"5min":0.781,"15min":0.781},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.247},{"interface":"front","average":{"1min":1.102,"5min":1.102,"15min":1.102},"min":{"1min":0.843,"5min":0.843,"15min":0.843},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.167}]},{"osd":6,"last update":"Tue Dec 24 22:05:14 2019","interfaces":[{"interface":"back","average":{"1min":1.290,"5min":1.290,"15min":1.290},"min":{"1min":0.907,"5min":0.907,"15min":0.907},"max":{"1min":1.620,"5min":1.620,"15min":1.620},"last":1.537},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.765,"5min":1.765,"15min":1.765},"last":1.398}]},{"osd":7,"last update":"Tue Dec 24 22:05:14 2019","interfaces":[{"interface":"back","average":{"1min":1.412,"5min":1.412,"15min":1.412},"min":{"1min":0.891,"5min":0.891,"15min":0.891},"max":{"1min":1.860,"5min":1.860,"15min":1.860},"last":1.689},{"interface":"front","average":{"1min":1.436,"5min":1.436,"15min":1.436},"min":{"1min":0.723,"5min":0.723,"15min":0.723},"max":{"1min":1.900,"5min":1.900,"15min":1.900},"last":1.638}]},{"osd":8,"last update":"Tue Dec 24 22:05:14 2019","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.555,"5min":0.555,"15min":0.555},"max":{"1min":2.050,"5min":2.050,"15min":2.050},"last":1.845},{"interface":"front","average":{"1min":1.368,"5min":1.368,"15min":1.368},"min":{"1min":0.605,"5min":0.605,"15min":0.605},"max":{"1min":1.822,"5min":1.822,"15min":1.822},"last":1.744}]},{"osd":10,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.315,"5min":1.315,"15min":1.315},"min":{"1min":0.865,"5min":0.865,"15min":0.865},"max":{"1min":1.713,"5min":1.713,"15min":1.713},"last":1.465},{"interface":"front","average":{"1min":1.662,"5min":1.662,"15min":1.662},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":2.128,"5min":2.128,"15min":2.128},"last":1.780}]}]},{"osd":8,"up_from":48,"seq":206158430240,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.887,"5min":0.873,"15min":0.871},"min":{"1min":0.512,"5min":0.512,"15min":0.512},"max":{"1min":1.441,"5min":2.639,"15min":2.639},"last":0.735},{"interface":"front","average":{"1min":0.795,"5min":0.792,"15min":0.792},"min":{"1min":0.480,"5min":0.480,"15min":0.480},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.831}]},{"osd":1,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.983,"5min":1.044,"15min":1.054},"min":{"1min":0.585,"5min":0.585,"15min":0.585},"max":{"1min":1.346,"5min":1.864,"15min":1.864},"last":1.378},{"interface":"front","average":{"1min":1.007,"5min":1.123,"15min":1.142},"min":{"1min":0.470,"5min":0.470,"15min":0.470},"max":{"1min":1.620,"5min":2.751,"15min":2.751},"last":0.955}]},{"osd":2,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.897,"5min":0.953,"15min":0.962},"min":{"1min":0.579,"5min":0.579,"15min":0.579},"max":{"1min":1.315,"5min":1.581,"15min":1.581},"last":0.895},{"interface":"front","average":{"1min":1.043,"5min":1.039,"15min":1.039},"min":{"1min":0.550,"5min":0.550,"15min":0.550},"max":{"1min":1.542,"5min":1.813,"15min":1.813},"last":0.571}]},{"osd":3,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.961,"5min":0.969,"15min":0.971},"min":{"1min":0.567,"5min":0.563,"15min":0.563},"max":{"1min":1.448,"5min":1.669,"15min":1.669},"last":1.177},{"interface":"front","average":{"1min":1.168,"5min":1.140,"15min":1.135},"min":{"1min":0.631,"5min":0.631,"15min":0.631},"max":{"1min":1.558,"5min":2.925,"15min":2.925},"last":1.264}]},{"osd":4,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.194,"15min":1.188},"min":{"1min":0.866,"5min":0.659,"15min":0.659},"max":{"1min":1.567,"5min":2.839,"15min":2.839},"last":1.060},{"interface":"front","average":{"1min":0.991,"5min":1.067,"15min":1.079},"min":{"1min":0.748,"5min":0.726,"15min":0.726},"max":{"1min":1.284,"5min":1.617,"15min":1.617},"last":0.644}]},{"osd":5,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.357,"15min":1.355},"min":{"1min":1.056,"5min":0.958,"15min":0.958},"max":{"1min":1.876,"5min":1.916,"15min":1.916},"last":1.232},{"interface":"front","average":{"1min":1.576,"5min":1.510,"15min":1.499},"min":{"1min":1.034,"5min":1.008,"15min":1.008},"max":{"1min":1.863,"5min":3.434,"15min":3.434},"last":1.424}]},{"osd":6,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.200,"15min":1.194},"min":{"1min":0.769,"5min":0.769,"15min":0.769},"max":{"1min":1.723,"5min":1.723,"15min":1.723},"last":0.931},{"interface":"front","average":{"1min":1.435,"5min":1.390,"15min":1.382},"min":{"1min":1.018,"5min":0.862,"15min":0.862},"max":{"1min":1.880,"5min":2.141,"15min":2.141},"last":1.153}]},{"osd":7,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.465,"5min":1.493,"15min":1.498},"min":{"1min":0.972,"5min":0.897,"15min":0.897},"max":{"1min":1.770,"5min":3.335,"15min":3.335},"last":1.337},{"interface":"front","average":{"1min":1.311,"5min":1.335,"15min":1.339},"min":{"1min":0.897,"5min":0.897,"15min":0.897},"max":{"1min":1.509,"5min":1.845,"15min":1.845},"last":1.036}]},{"osd":9,"last update":"Tue Dec 24 22:05:16 2019","interfaces":[{"interface":"back","average":{"1min":1.334,"5min":1.334,"15min":1.334},"min":{"1min":0.523,"5min":0.523,"15min":0.523},"max":{"1min":1.676,"5min":1.676,"15min":1.676},"last":1.206},{"interface":"front","average":{"1min":1.279,"5min":1.279,"15min":1.279},"min":{"1min":0.693,"5min":0.693,"15min":0.693},"max":{"1min":1.747,"5min":1.747,"15min":1.747},"last":1.106}]},{"osd":10,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.390,"5min":1.390,"15min":1.390},"min":{"1min":0.854,"5min":0.854,"15min":0.854},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.312},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.705,"5min":0.705,"15min":0.705},"max":{"1min":2.257,"5min":2.257,"15min":2.257},"last":1.478}]}]},{"osd":7,"up_from":43,"seq":184683593764,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.142,"15min":1.152},"min":{"1min":0.701,"5min":0.701,"15min":0.701},"max":{"1min":1.766,"5min":2.044,"15min":2.044},"last":1.301},{"interface":"front","average":{"1min":1.085,"5min":1.129,"15min":1.136},"min":{"1min":0.652,"5min":0.630,"15min":0.630},"max":{"1min":1.942,"5min":1.954,"15min":1.954},"last":0.716}]},{"osd":1,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.186,"5min":1.015,"15min":0.987},"min":{"1min":0.686,"5min":0.567,"15min":0.567},"max":{"1min":1.688,"5min":1.688,"15min":1.688},"last":1.405},{"interface":"front","average":{"1min":1.193,"5min":1.077,"15min":1.057},"min":{"1min":0.612,"5min":0.612,"15min":0.612},"max":{"1min":1.945,"5min":1.945,"15min":1.945},"last":0.999}]},{"osd":2,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.253,"5min":1.104,"15min":1.079},"min":{"1min":0.829,"5min":0.646,"15min":0.646},"max":{"1min":1.880,"5min":2.181,"15min":2.181},"last":1.484},{"interface":"front","average":{"1min":1.137,"5min":1.133,"15min":1.132},"min":{"1min":0.780,"5min":0.592,"15min":0.592},"max":{"1min":1.813,"5min":1.813,"15min":1.813},"last":1.090}]},{"osd":3,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.185,"5min":1.135,"15min":1.127},"min":{"1min":0.684,"5min":0.636,"15min":0.636},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.570},{"interface":"front","average":{"1min":1.102,"5min":1.113,"15min":1.115},"min":{"1min":0.794,"5min":0.772,"15min":0.772},"max":{"1min":1.444,"5min":1.759,"15min":1.759},"last":1.244}]},{"osd":4,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":0.917,"5min":1.057,"15min":1.081},"min":{"1min":0.511,"5min":0.494,"15min":0.494},"max":{"1min":1.403,"5min":2.270,"15min":2.270},"last":1.200},{"interface":"front","average":{"1min":1.004,"5min":1.118,"15min":1.137},"min":{"1min":0.703,"5min":0.703,"15min":0.703},"max":{"1min":1.603,"5min":1.815,"15min":1.815},"last":0.838}]},{"osd":5,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.357,"15min":1.363},"min":{"1min":0.723,"5min":0.723,"15min":0.723},"max":{"1min":1.878,"5min":2.144,"15min":2.144},"last":1.034},{"interface":"front","average":{"1min":1.459,"5min":1.373,"15min":1.359},"min":{"1min":0.824,"5min":0.638,"15min":0.638},"max":{"1min":2.150,"5min":2.412,"15min":2.412},"last":1.435}]},{"osd":6,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.497,"15min":1.515},"min":{"1min":0.869,"5min":0.869,"15min":0.869},"max":{"1min":2.447,"5min":2.668,"15min":2.668},"last":1.665},{"interface":"front","average":{"1min":1.479,"5min":1.437,"15min":1.430},"min":{"1min":0.851,"5min":0.851,"15min":0.851},"max":{"1min":2.011,"5min":2.039,"15min":2.039},"last":1.348}]},{"osd":8,"last update":"Tue Dec 24 22:06:03 2019","interfaces":[{"interface":"back","average":{"1min":1.563,"5min":1.631,"15min":1.643},"min":{"1min":0.825,"5min":0.825,"15min":0.825},"max":{"1min":2.549,"5min":2.549,"15min":2.549},"last":1.803},{"interface":"front","average":{"1min":1.528,"5min":1.608,"15min":1.621},"min":{"1min":0.965,"5min":0.965,"15min":0.965},"max":{"1min":2.215,"5min":2.442,"15min":2.442},"last":1.531}]},{"osd":9,"last update":"Tue Dec 24 22:05:13 2019","interfaces":[{"interface":"back","average":{"1min":1.701,"5min":1.701,"15min":1.701},"min":{"1min":1.136,"5min":1.136,"15min":1.136},"max":{"1min":2.558,"5min":2.558,"15min":2.558},"last":1.959},{"interface":"front","average":{"1min":1.788,"5min":1.788,"15min":1.788},"min":{"1min":1.242,"5min":1.242,"15min":1.242},"max":{"1min":2.398,"5min":2.398,"15min":2.398},"last":1.612}]},{"osd":10,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.727,"5min":1.727,"15min":1.727},"min":{"1min":1.379,"5min":1.379,"15min":1.379},"max":{"1min":2.372,"5min":2.372,"15min":2.372},"last":1.905},{"interface":"front","average":{"1min":1.739,"5min":1.739,"15min":1.739},"min":{"1min":1.304,"5min":1.304,"15min":1.304},"max":{"1min":2.289,"5min":2.289,"15min":2.289},"last":2.078}]}]},{"osd":6,"up_from":38,"seq":163208757288,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:18 2019","interfaces":[{"interface":"back","average":{"1min":0.958,"5min":0.994,"15min":1.000},"min":{"1min":0.659,"5min":0.462,"15min":0.462},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.718},{"interface":"front","average":{"1min":0.935,"5min":0.979,"15min":0.986},"min":{"1min":0.548,"5min":0.548,"15min":0.548},"max":{"1min":1.550,"5min":1.737,"15min":1.737},"last":1.103}]},{"osd":1,"last update":"Tue Dec 24 22:05:18 2019","interfaces":[{"interface":"back","average":{"1min":1.348,"5min":1.009,"15min":0.953},"min":{"1min":0.684,"5min":0.574,"15min":0.574},"max":{"1min":7.126,"5min":7.126,"15min":7.126},"last":0.777},{"interface":"front","average":{"1min":1.421,"5min":1.066,"15min":1.007},"min":{"1min":0.731,"5min":0.677,"15min":0.677},"max":{"1min":7.085,"5min":7.085,"15min":7.085},"last":0.851}]},{"osd":2,"last update":"Tue Dec 24 22:05:18 2019","interfaces":[{"interface":"back","average":{"1min":1.136,"5min":1.115,"15min":1.111},"min":{"1min":0.688,"5min":0.688,"15min":0.688},"max":{"1min":1.762,"5min":1.941,"15min":1.941},"last":1.220},{"interface":"front","average":{"1min":1.118,"5min":1.170,"15min":1.179},"min":{"1min":0.730,"5min":0.608,"15min":0.608},"max":{"1min":1.458,"5min":2.626,"15min":2.626},"last":1.555}]},{"osd":3,"last update":"Tue Dec 24 22:05:18 2019","interfaces":[{"interface":"back","average":{"1min":1.100,"5min":1.056,"15min":1.049},"min":{"1min":0.737,"5min":0.737,"15min":0.737},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.591},{"interface":"front","average":{"1min":0.965,"5min":1.137,"15min":1.165},"min":{"1min":0.591,"5min":0.591,"15min":0.591},"max":{"1min":1.619,"5min":1.646,"15min":1.646},"last":1.160}]},{"osd":4,"last update":"Tue Dec 24 22:05:18 2019","interfaces":[{"interface":"back","average":{"1min":1.126,"5min":1.123,"15min":1.123},"min":{"1min":0.807,"5min":0.485,"15min":0.485},"max":{"1min":1.473,"5min":1.724,"15min":1.724},"last":1.731},{"interface":"front","average":{"1min":1.212,"5min":1.206,"15min":1.205},"min":{"1min":0.814,"5min":0.700,"15min":0.700},"max":{"1min":1.555,"5min":2.005,"15min":2.005},"last":1.267}]},{"osd":5,"last update":"Tue Dec 24 22:05:18 2019","interfaces":[{"interface":"back","average":{"1min":1.352,"5min":1.327,"15min":1.323},"min":{"1min":0.934,"5min":0.620,"15min":0.620},"max":{"1min":2.033,"5min":2.033,"15min":2.033},"last":0.982},{"interface":"front","average":{"1min":1.324,"5min":1.350,"15min":1.354},"min":{"1min":0.614,"5min":0.614,"15min":0.614},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.320}]},{"osd":7,"last update":"Tue Dec 24 22:05:38 2019","interfaces":[{"interface":"back","average":{"1min":1.186,"5min":1.318,"15min":1.340},"min":{"1min":0.779,"5min":0.681,"15min":0.681},"max":{"1min":1.512,"5min":1.948,"15min":1.948},"last":1.420},{"interface":"front","average":{"1min":1.405,"5min":1.401,"15min":1.400},"min":{"1min":1.013,"5min":0.708,"15min":0.708},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":1.066}]},{"osd":8,"last update":"Tue Dec 24 22:05:58 2019","interfaces":[{"interface":"back","average":{"1min":1.615,"5min":1.699,"15min":1.713},"min":{"1min":1.200,"5min":1.200,"15min":1.200},"max":{"1min":2.000,"5min":2.450,"15min":2.450},"last":1.677},{"interface":"front","average":{"1min":1.517,"5min":1.655,"15min":1.678},"min":{"1min":1.236,"5min":1.236,"15min":1.236},"max":{"1min":1.937,"5min":2.224,"15min":2.224},"last":0.929}]},{"osd":9,"last update":"Tue Dec 24 22:05:13 2019","interfaces":[{"interface":"back","average":{"1min":1.805,"5min":1.805,"15min":1.805},"min":{"1min":1.426,"5min":1.426,"15min":1.426},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":1.480},{"interface":"front","average":{"1min":1.691,"5min":1.691,"15min":1.691},"min":{"1min":1.115,"5min":1.115,"15min":1.115},"max":{"1min":2.629,"5min":2.629,"15min":2.629},"last":1.514}]},{"osd":10,"last update":"Tue Dec 24 22:05:38 2019","interfaces":[{"interface":"back","average":{"1min":1.814,"5min":1.814,"15min":1.814},"min":{"1min":1.465,"5min":1.465,"15min":1.465},"max":{"1min":2.603,"5min":2.603,"15min":2.603},"last":1.358},{"interface":"front","average":{"1min":1.699,"5min":1.699,"15min":1.699},"min":{"1min":1.314,"5min":1.314,"15min":1.314},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.904}]}]},{"osd":1,"up_from":12,"seq":51539607613,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:37 2019","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.748,"15min":0.670},"min":{"1min":0.611,"5min":0.406,"15min":0.406},"max":{"1min":1.267,"5min":1.491,"15min":1.491},"last":1.101},{"interface":"front","average":{"1min":0.839,"5min":0.777,"15min":0.745},"min":{"1min":0.539,"5min":0.285,"15min":0.285},"max":{"1min":1.340,"5min":1.701,"15min":1.701},"last":0.615}]},{"osd":2,"last update":"Tue Dec 24 22:06:00 2019","interfaces":[{"interface":"back","average":{"1min":0.812,"5min":0.830,"15min":0.787},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.626,"5min":1.626,"15min":1.626},"last":0.573},{"interface":"front","average":{"1min":0.926,"5min":0.789,"15min":0.772},"min":{"1min":0.538,"5min":0.538,"15min":0.538},"max":{"1min":2.075,"5min":2.075,"15min":2.075},"last":1.311}]},{"osd":3,"last update":"Tue Dec 24 22:06:14 2019","interfaces":[{"interface":"back","average":{"1min":0.919,"5min":0.902,"15min":0.819},"min":{"1min":0.521,"5min":0.515,"15min":0.515},"max":{"1min":1.728,"5min":1.866,"15min":1.866},"last":0.719},{"interface":"front","average":{"1min":1.112,"5min":1.042,"15min":0.983},"min":{"1min":0.508,"5min":0.508,"15min":0.508},"max":{"1min":2.152,"5min":2.152,"15min":2.152},"last":0.786}]},{"osd":4,"last update":"Tue Dec 24 22:05:37 2019","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.981,"15min":0.951},"min":{"1min":0.624,"5min":0.585,"15min":0.585},"max":{"1min":1.740,"5min":1.740,"15min":1.740},"last":0.948},{"interface":"front","average":{"1min":1.252,"5min":1.098,"15min":1.051},"min":{"1min":0.831,"5min":0.701,"15min":0.701},"max":{"1min":1.747,"5min":1.843,"15min":1.843},"last":0.875}]},{"osd":5,"last update":"Tue Dec 24 22:06:00 2019","interfaces":[{"interface":"back","average":{"1min":1.289,"5min":1.283,"15min":1.309},"min":{"1min":0.829,"5min":0.733,"15min":0.733},"max":{"1min":2.551,"5min":2.551,"15min":2.551},"last":1.791},{"interface":"front","average":{"1min":1.471,"5min":1.153,"15min":1.005},"min":{"1min":0.921,"5min":0.619,"15min":0.619},"max":{"1min":2.243,"5min":2.243,"15min":2.243},"last":1.272}]},{"osd":6,"last update":"Tue Dec 24 22:05:17 2019","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.225,"15min":1.193},"min":{"1min":0.618,"5min":0.618,"15min":0.618},"max":{"1min":2.079,"5min":2.079,"15min":2.079},"last":1.172},{"interface":"front","average":{"1min":1.560,"5min":1.495,"15min":1.484},"min":{"1min":0.802,"5min":0.802,"15min":0.802},"max":{"1min":2.358,"5min":2.358,"15min":2.358},"last":1.041}]},{"osd":7,"last update":"Tue Dec 24 22:05:37 2019","interfaces":[{"interface":"back","average":{"1min":1.485,"5min":1.359,"15min":1.338},"min":{"1min":0.972,"5min":0.970,"15min":0.970},"max":{"1min":2.212,"5min":2.212,"15min":2.212},"last":1.244},{"interface":"front","average":{"1min":1.643,"5min":1.569,"15min":1.557},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":2.475,"5min":2.475,"15min":2.475},"last":1.202}]},{"osd":8,"last update":"Tue Dec 24 22:06:00 2019","interfaces":[{"interface":"back","average":{"1min":1.582,"5min":1.633,"15min":1.641},"min":{"1min":1.093,"5min":1.093,"15min":1.093},"max":{"1min":2.716,"5min":2.716,"15min":2.716},"last":1.917},{"interface":"front","average":{"1min":1.528,"5min":1.660,"15min":1.682},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":2.032,"5min":2.556,"15min":2.556},"last":1.391}]},{"osd":9,"last update":"Tue Dec 24 22:06:14 2019","interfaces":[{"interface":"back","average":{"1min":1.683,"5min":1.508,"15min":1.479},"min":{"1min":0.985,"5min":0.985,"15min":0.985},"max":{"1min":2.631,"5min":2.631,"15min":2.631},"last":2.034},{"interface":"front","average":{"1min":1.650,"5min":1.704,"15min":1.713},"min":{"1min":1.083,"5min":1.083,"15min":1.083},"max":{"1min":2.319,"5min":2.621,"15min":2.621},"last":1.419}]},{"osd":10,"last update":"Tue Dec 24 22:05:37 2019","interfaces":[{"interface":"back","average":{"1min":1.500,"5min":1.500,"15min":1.500},"min":{"1min":1.125,"5min":1.125,"15min":1.125},"max":{"1min":2.180,"5min":2.180,"15min":2.180},"last":1.975},{"interface":"front","average":{"1min":1.705,"5min":1.705,"15min":1.705},"min":{"1min":1.237,"5min":1.237,"15min":1.237},"max":{"1min":2.759,"5min":2.759,"15min":2.759},"last":1.362}]}]},{"osd":0,"up_from":7,"seq":30064771137,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 24 22:05:40 2019","interfaces":[{"interface":"back","average":{"1min":0.799,"5min":0.651,"15min":0.578},"min":{"1min":0.465,"5min":0.355,"15min":0.355},"max":{"1min":1.568,"5min":1.568,"15min":1.568},"last":1.175},{"interface":"front","average":{"1min":0.903,"5min":0.782,"15min":0.672},"min":{"1min":0.478,"5min":0.437,"15min":0.437},"max":{"1min":1.428,"5min":1.505,"15min":1.505},"last":0.637}]},{"osd":2,"last update":"Tue Dec 24 22:03:53 2019","interfaces":[{"interface":"back","average":{"1min":0.700,"5min":0.667,"15min":0.661},"min":{"1min":0.512,"5min":0.371,"15min":0.371},"max":{"1min":0.944,"5min":0.944,"15min":0.944},"last":0.545},{"interface":"front","average":{"1min":0.927,"5min":0.779,"15min":0.755},"min":{"1min":0.614,"5min":0.452,"15min":0.452},"max":{"1min":1.197,"5min":1.197,"15min":1.197},"last":0.705}]},{"osd":3,"last update":"Tue Dec 24 22:05:16 2019","interfaces":[{"interface":"back","average":{"1min":1.122,"5min":0.874,"15min":0.804},"min":{"1min":0.623,"5min":0.508,"15min":0.508},"max":{"1min":2.013,"5min":2.013,"15min":2.013},"last":1.309},{"interface":"front","average":{"1min":0.908,"5min":0.860,"15min":0.847},"min":{"1min":0.489,"5min":0.489,"15min":0.489},"max":{"1min":1.580,"5min":1.580,"15min":1.580},"last":0.711}]},{"osd":4,"last update":"Tue Dec 24 22:05:40 2019","interfaces":[{"interface":"back","average":{"1min":0.963,"5min":1.045,"15min":1.046},"min":{"1min":0.671,"5min":0.571,"15min":0.571},"max":{"1min":1.496,"5min":1.577,"15min":1.577},"last":0.807},{"interface":"front","average":{"1min":1.349,"5min":1.191,"15min":1.122},"min":{"1min":0.849,"5min":0.707,"15min":0.707},"max":{"1min":1.930,"5min":1.930,"15min":1.930},"last":1.806}]},{"osd":5,"last update":"Tue Dec 24 22:05:58 2019","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.121,"15min":1.128},"min":{"1min":0.549,"5min":0.549,"15min":0.549},"max":{"1min":1.702,"5min":2.085,"15min":2.085},"last":0.921},{"interface":"front","average":{"1min":1.378,"5min":1.264,"15min":1.192},"min":{"1min":0.910,"5min":0.887,"15min":0.887},"max":{"1min":2.325,"5min":2.325,"15min":2.325},"last":1.882}]},{"osd":6,"last update":"Tue Dec 24 22:05:16 2019","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.221,"15min":1.209},"min":{"1min":0.709,"5min":0.709,"15min":0.709},"max":{"1min":2.019,"5min":2.019,"15min":2.019},"last":1.102},{"interface":"front","average":{"1min":1.341,"5min":1.335,"15min":1.334},"min":{"1min":0.846,"5min":0.832,"15min":0.832},"max":{"1min":1.882,"5min":1.970,"15min":1.970},"last":1.046}]},{"osd":7,"last update":"Tue Dec 24 22:05:40 2019","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.307,"15min":1.321},"min":{"1min":0.750,"5min":0.750,"15min":0.750},"max":{"1min":2.114,"5min":2.114,"15min":2.114},"last":1.392},{"interface":"front","average":{"1min":1.411,"5min":1.432,"15min":1.436},"min":{"1min":0.774,"5min":0.774,"15min":0.774},"max":{"1min":2.231,"5min":2.231,"15min":2.231},"last":1.977}]},{"osd":8,"last update":"Tue Dec 24 22:05:58 2019","interfaces":[{"interface":"back","average":{"1min":1.567,"5min":1.656,"15min":1.671},"min":{"1min":1.030,"5min":1.030,"15min":1.030},"max":{"1min":3.015,"5min":3.015,"15min":3.015},"last":2.110},{"interface":"front","average":{"1min":1.444,"5min":1.484,"15min":1.490},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.771,"5min":2.771,"15min":2.771},"last":1.148}]},{"osd":9,"last update":"Tue Dec 24 22:05:16 2019","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.613,"15min":1.613},"min":{"1min":0.712,"5min":0.712,"15min":0.712},"max":{"1min":2.652,"5min":2.652,"15min":2.652},"last":2.166},{"interface":"front","average":{"1min":1.467,"5min":1.467,"15min":1.467},"min":{"1min":0.792,"5min":0.792,"15min":0.792},"max":{"1min":2.175,"5min":2.175,"15min":2.175},"last":1.470}]},{"osd":10,"last update":"Tue Dec 24 22:05:35 2019","interfaces":[{"interface":"back","average":{"1min":1.490,"5min":1.490,"15min":1.490},"min":{"1min":0.835,"5min":0.835,"15min":0.835},"max":{"1min":2.424,"5min":2.424,"15min":2.424},"last":1.254},{"interface":"front","average":{"1min":1.739,"5min":1.739,"15min":1.739},"min":{"1min":1.192,"5min":1.192,"15min":1.192},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":2.034}]},{"osd":11,"last update":"Tue Dec 24 22:05:53 2019","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.986,"5min":0.986,"15min":0.986},"max":{"1min":2.571,"5min":2.571,"15min":2.571},"last":1.576},{"interface":"front","average":{"1min":1.864,"5min":1.864,"15min":1.864},"min":{"1min":1.023,"5min":1.023,"15min":1.023},"max":{"1min":9.942,"5min":9.942,"15min":9.942},"last":1.436}]}]},{"osd":2,"up_from":17,"seq":73014444088,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:06:02 2019","interfaces":[{"interface":"back","average":{"1min":0.851,"5min":0.717,"15min":0.651},"min":{"1min":0.440,"5min":0.409,"15min":0.409},"max":{"1min":1.481,"5min":1.481,"15min":1.481},"last":0.659},{"interface":"front","average":{"1min":0.813,"5min":0.771,"15min":0.735},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.950}]},{"osd":1,"last update":"Tue Dec 24 22:06:02 2019","interfaces":[{"interface":"back","average":{"1min":0.840,"5min":0.741,"15min":0.685},"min":{"1min":0.510,"5min":0.448,"15min":0.448},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.741},{"interface":"front","average":{"1min":1.022,"5min":0.923,"15min":0.836},"min":{"1min":0.431,"5min":0.431,"15min":0.431},"max":{"1min":1.705,"5min":1.705,"15min":1.705},"last":1.155}]},{"osd":3,"last update":"Tue Dec 24 22:05:17 2019","interfaces":[{"interface":"back","average":{"1min":0.977,"5min":0.822,"15min":0.768},"min":{"1min":0.528,"5min":0.519,"15min":0.519},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.887},{"interface":"front","average":{"1min":1.143,"5min":0.896,"15min":0.841},"min":{"1min":0.598,"5min":0.513,"15min":0.513},"max":{"1min":1.549,"5min":1.549,"15min":1.549},"last":1.034}]},{"osd":4,"last update":"Tue Dec 24 22:05:38 2019","interfaces":[{"interface":"back","average":{"1min":1.037,"5min":0.967,"15min":0.940},"min":{"1min":0.597,"5min":0.494,"15min":0.494},"max":{"1min":1.971,"5min":1.973,"15min":1.973},"last":1.224},{"interface":"front","average":{"1min":1.140,"5min":1.069,"15min":1.045},"min":{"1min":0.551,"5min":0.551,"15min":0.551},"max":{"1min":1.615,"5min":2.039,"15min":2.039},"last":1.113}]},{"osd":5,"last update":"Tue Dec 24 22:06:02 2019","interfaces":[{"interface":"back","average":{"1min":1.539,"5min":1.253,"15min":1.161},"min":{"1min":0.912,"5min":0.788,"15min":0.788},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.280},{"interface":"front","average":{"1min":1.372,"5min":1.122,"15min":1.063},"min":{"1min":0.665,"5min":0.548,"15min":0.548},"max":{"1min":2.299,"5min":2.299,"15min":2.299},"last":1.356}]},{"osd":6,"last update":"Tue Dec 24 22:05:17 2019","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.215,"15min":1.163},"min":{"1min":0.824,"5min":0.816,"15min":0.816},"max":{"1min":2.366,"5min":2.366,"15min":2.366},"last":1.643},{"interface":"front","average":{"1min":1.283,"5min":1.390,"15min":1.408},"min":{"1min":0.680,"5min":0.680,"15min":0.680},"max":{"1min":2.777,"5min":2.777,"15min":2.777},"last":1.522}]},{"osd":7,"last update":"Tue Dec 24 22:05:36 2019","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.566,"15min":1.563},"min":{"1min":1.135,"5min":1.135,"15min":1.135},"max":{"1min":2.150,"5min":2.190,"15min":2.190},"last":1.585},{"interface":"front","average":{"1min":1.286,"5min":1.306,"15min":1.310},"min":{"1min":0.634,"5min":0.634,"15min":0.634},"max":{"1min":1.897,"5min":1.962,"15min":1.962},"last":1.495}]},{"osd":8,"last update":"Tue Dec 24 22:06:02 2019","interfaces":[{"interface":"back","average":{"1min":1.259,"5min":1.385,"15min":1.406},"min":{"1min":0.836,"5min":0.836,"15min":0.836},"max":{"1min":2.106,"5min":2.885,"15min":2.885},"last":1.328},{"interface":"front","average":{"1min":1.654,"5min":1.724,"15min":1.736},"min":{"1min":0.981,"5min":0.981,"15min":0.981},"max":{"1min":2.614,"5min":2.614,"15min":2.614},"last":1.449}]},{"osd":9,"last update":"Tue Dec 24 22:06:14 2019","interfaces":[{"interface":"back","average":{"1min":1.745,"5min":1.796,"15min":1.804},"min":{"1min":0.909,"5min":0.909,"15min":0.909},"max":{"1min":3.137,"5min":3.137,"15min":3.137},"last":1.710},{"interface":"front","average":{"1min":1.378,"5min":1.459,"15min":1.473},"min":{"1min":0.786,"5min":0.786,"15min":0.786},"max":{"1min":2.132,"5min":2.132,"15min":2.132},"last":1.558}]},{"osd":10,"last update":"Tue Dec 24 22:05:36 2019","interfaces":[{"interface":"back","average":{"1min":1.813,"5min":1.813,"15min":1.813},"min":{"1min":1.363,"5min":1.363,"15min":1.363},"max":{"1min":2.542,"5min":2.542,"15min":2.542},"last":1.760},{"interface":"front","average":{"1min":1.517,"5min":1.517,"15min":1.517},"min":{"1min":0.941,"5min":0.941,"15min":0.941},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.422}]}]},{"osd":3,"up_from":22,"seq":94489280563,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049224,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695928,"statfs":{"total":95995035648,"available":94920630272,"internally_reserved":1073741824,"allocated":655360,"data_stored":310694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:04:18 2019","interfaces":[{"interface":"back","average":{"1min":0.605,"5min":0.621,"15min":0.623},"min":{"1min":0.400,"5min":0.400,"15min":0.400},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":1.050},{"interface":"front","average":{"1min":0.747,"5min":0.759,"15min":0.761},"min":{"1min":0.459,"5min":0.449,"15min":0.449},"max":{"1min":1.095,"5min":1.130,"15min":1.130},"last":1.150}]},{"osd":1,"last update":"Tue Dec 24 22:05:20 2019","interfaces":[{"interface":"back","average":{"1min":0.927,"5min":0.737,"15min":0.706},"min":{"1min":0.495,"5min":0.465,"15min":0.465},"max":{"1min":3.316,"5min":3.316,"15min":3.316},"last":0.848},{"interface":"front","average":{"1min":1.148,"5min":0.923,"15min":0.889},"min":{"1min":0.525,"5min":0.525,"15min":0.525},"max":{"1min":3.686,"5min":3.686,"15min":3.686},"last":1.057}]},{"osd":2,"last update":"Tue Dec 24 22:05:20 2019","interfaces":[{"interface":"back","average":{"1min":0.923,"5min":0.860,"15min":0.852},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.696,"5min":2.696,"15min":2.696},"last":0.654},{"interface":"front","average":{"1min":0.933,"5min":0.850,"15min":0.845},"min":{"1min":0.393,"5min":0.393,"15min":0.393},"max":{"1min":1.525,"5min":1.525,"15min":1.525},"last":0.742}]},{"osd":4,"last update":"Tue Dec 24 22:05:40 2019","interfaces":[{"interface":"back","average":{"1min":1.200,"5min":1.142,"15min":1.140},"min":{"1min":0.667,"5min":0.667,"15min":0.667},"max":{"1min":1.620,"5min":1.825,"15min":1.825},"last":0.944},{"interface":"front","average":{"1min":1.040,"5min":1.064,"15min":1.051},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.363}]},{"osd":5,"last update":"Tue Dec 24 22:05:54 2019","interfaces":[{"interface":"back","average":{"1min":1.428,"5min":1.294,"15min":1.237},"min":{"1min":0.806,"5min":0.806,"15min":0.806},"max":{"1min":2.799,"5min":2.799,"15min":2.799},"last":1.321},{"interface":"front","average":{"1min":1.292,"5min":1.210,"15min":1.167},"min":{"1min":0.743,"5min":0.731,"15min":0.731},"max":{"1min":2.624,"5min":2.624,"15min":2.624},"last":1.577}]},{"osd":6,"last update":"Tue Dec 24 22:05:20 2019","interfaces":[{"interface":"back","average":{"1min":1.408,"5min":1.320,"15min":1.306},"min":{"1min":0.732,"5min":0.732,"15min":0.732},"max":{"1min":3.034,"5min":3.034,"15min":3.034},"last":1.006},{"interface":"front","average":{"1min":1.370,"5min":1.266,"15min":1.248},"min":{"1min":0.917,"5min":0.861,"15min":0.861},"max":{"1min":2.370,"5min":2.370,"15min":2.370},"last":1.680}]},{"osd":7,"last update":"Tue Dec 24 22:05:40 2019","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.269,"15min":1.273},"min":{"1min":0.662,"5min":0.662,"15min":0.662},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":1.275},{"interface":"front","average":{"1min":1.683,"5min":1.520,"15min":1.493},"min":{"1min":0.707,"5min":0.707,"15min":0.707},"max":{"1min":3.368,"5min":3.368,"15min":3.368},"last":1.163}]},{"osd":8,"last update":"Tue Dec 24 22:05:54 2019","interfaces":[{"interface":"back","average":{"1min":1.580,"5min":1.690,"15min":1.708},"min":{"1min":0.639,"5min":0.639,"15min":0.639},"max":{"1min":3.927,"5min":3.927,"15min":3.927},"last":1.491},{"interface":"front","average":{"1min":1.308,"5min":1.380,"15min":1.392},"min":{"1min":0.785,"5min":0.785,"15min":0.785},"max":{"1min":2.430,"5min":2.430,"15min":2.430},"last":1.451}]},{"osd":9,"last update":"Tue Dec 24 22:05:14 2019","interfaces":[{"interface":"back","average":{"1min":1.820,"5min":1.820,"15min":1.820},"min":{"1min":0.982,"5min":0.982,"15min":0.982},"max":{"1min":3.583,"5min":3.583,"15min":3.583},"last":1.801},{"interface":"front","average":{"1min":1.589,"5min":1.589,"15min":1.589},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":2.914,"5min":2.914,"15min":2.914},"last":1.738}]},{"osd":10,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.862,"5min":1.862,"15min":1.862},"min":{"1min":1.110,"5min":1.110,"15min":1.110},"max":{"1min":3.759,"5min":3.759,"15min":3.759},"last":2.004},{"interface":"front","average":{"1min":1.572,"5min":1.572,"15min":1.572},"min":{"1min":0.855,"5min":0.855,"15min":0.855},"max":{"1min":3.187,"5min":3.187,"15min":3.187},"last":1.874}]},{"osd":11,"last update":"Tue Dec 24 22:05:54 2019","interfaces":[{"interface":"back","average":{"1min":1.666,"5min":1.666,"15min":1.666},"min":{"1min":1.074,"5min":1.074,"15min":1.074},"max":{"1min":2.540,"5min":2.540,"15min":2.540},"last":1.920},{"interface":"front","average":{"1min":1.602,"5min":1.602,"15min":1.602},"min":{"1min":0.866,"5min":0.866,"15min":0.866},"max":{"1min":4.079,"5min":4.079,"15min":4.079},"last":1.645}]}]},{"osd":4,"up_from":27,"seq":115964117040,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049224,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695928,"statfs":{"total":95995035648,"available":94920630272,"internally_reserved":1073741824,"allocated":655360,"data_stored":310694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.156,"5min":0.984,"15min":0.924},"min":{"1min":0.641,"5min":0.441,"15min":0.441},"max":{"1min":2.050,"5min":2.050,"15min":2.050},"last":0.922},{"interface":"front","average":{"1min":0.933,"5min":1.052,"15min":1.080},"min":{"1min":0.637,"5min":0.584,"15min":0.584},"max":{"1min":1.418,"5min":1.653,"15min":1.653},"last":1.002}]},{"osd":1,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":0.902,"5min":0.909,"15min":0.903},"min":{"1min":0.602,"5min":0.592,"15min":0.592},"max":{"1min":1.795,"5min":1.795,"15min":1.795},"last":0.884},{"interface":"front","average":{"1min":1.297,"5min":1.185,"15min":1.149},"min":{"1min":0.574,"5min":0.574,"15min":0.574},"max":{"1min":1.946,"5min":2.229,"15min":2.229},"last":1.293}]},{"osd":2,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.098,"5min":0.998,"15min":0.952},"min":{"1min":0.676,"5min":0.550,"15min":0.550},"max":{"1min":1.862,"5min":2.144,"15min":2.144},"last":0.531},{"interface":"front","average":{"1min":1.096,"5min":1.048,"15min":1.050},"min":{"1min":0.748,"5min":0.564,"15min":0.564},"max":{"1min":1.481,"5min":1.821,"15min":1.821},"last":1.340}]},{"osd":3,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.358,"5min":1.124,"15min":1.068},"min":{"1min":0.714,"5min":0.637,"15min":0.637},"max":{"1min":1.799,"5min":1.799,"15min":1.799},"last":1.164},{"interface":"front","average":{"1min":1.313,"5min":1.042,"15min":0.969},"min":{"1min":0.975,"5min":0.585,"15min":0.585},"max":{"1min":1.655,"5min":1.852,"15min":1.852},"last":1.249}]},{"osd":5,"last update":"Tue Dec 24 22:06:09 2019","interfaces":[{"interface":"back","average":{"1min":1.251,"5min":1.132,"15min":1.055},"min":{"1min":0.645,"5min":0.510,"15min":0.510},"max":{"1min":1.773,"5min":2.081,"15min":2.081},"last":1.055},{"interface":"front","average":{"1min":1.165,"5min":1.131,"15min":1.125},"min":{"1min":0.644,"5min":0.557,"15min":0.557},"max":{"1min":1.601,"5min":2.611,"15min":2.611},"last":1.127}]},{"osd":6,"last update":"Tue Dec 24 22:05:17 2019","interfaces":[{"interface":"back","average":{"1min":1.457,"5min":1.296,"15min":1.269},"min":{"1min":1.008,"5min":0.576,"15min":0.576},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.501},{"interface":"front","average":{"1min":1.158,"5min":1.145,"15min":1.143},"min":{"1min":0.820,"5min":0.768,"15min":0.768},"max":{"1min":2.187,"5min":2.187,"15min":2.187},"last":0.669}]},{"osd":7,"last update":"Tue Dec 24 22:05:38 2019","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.356,"15min":1.366},"min":{"1min":0.690,"5min":0.663,"15min":0.663},"max":{"1min":1.833,"5min":1.916,"15min":1.916},"last":1.439},{"interface":"front","average":{"1min":1.324,"5min":1.341,"15min":1.344},"min":{"1min":1.049,"5min":1.042,"15min":1.042},"max":{"1min":1.714,"5min":2.336,"15min":2.336},"last":1.410}]},{"osd":8,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.692,"5min":1.742,"15min":1.750},"min":{"1min":1.262,"5min":1.245,"15min":1.245},"max":{"1min":2.341,"5min":2.341,"15min":2.341},"last":1.381},{"interface":"front","average":{"1min":1.638,"5min":1.622,"15min":1.619},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":1.468}]},{"osd":9,"last update":"Tue Dec 24 22:05:13 2019","interfaces":[{"interface":"back","average":{"1min":1.461,"5min":1.461,"15min":1.461},"min":{"1min":0.946,"5min":0.946,"15min":0.946},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":1.087},{"interface":"front","average":{"1min":1.756,"5min":1.756,"15min":1.756},"min":{"1min":1.346,"5min":1.346,"15min":1.346},"max":{"1min":2.277,"5min":2.277,"15min":2.277},"last":1.559}]},{"osd":10,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.563,"5min":1.563,"15min":1.563},"min":{"1min":1.089,"5min":1.089,"15min":1.089},"max":{"1min":1.902,"5min":1.902,"15min":1.902},"last":1.209},{"interface":"front","average":{"1min":1.893,"5min":1.893,"15min":1.893},"min":{"1min":1.447,"5min":1.447,"15min":1.447},"max":{"1min":2.356,"5min":2.356,"15min":2.356},"last":1.607}]}]},{"osd":5,"up_from":32,"seq":137438953516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049224,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695928,"statfs":{"total":95995035648,"available":94920630272,"internally_reserved":1073741824,"allocated":655360,"data_stored":310694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:06:06 2019","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.888,"15min":0.830},"min":{"1min":0.630,"5min":0.466,"15min":0.466},"max":{"1min":2.180,"5min":2.180,"15min":2.180},"last":0.773},{"interface":"front","average":{"1min":1.187,"5min":1.031,"15min":0.982},"min":{"1min":0.796,"5min":0.613,"15min":0.613},"max":{"1min":2.320,"5min":2.320,"15min":2.320},"last":0.889}]},{"osd":1,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.057,"5min":1.069,"15min":1.075},"min":{"1min":0.554,"5min":0.554,"15min":0.554},"max":{"1min":1.864,"5min":1.864,"15min":1.864},"last":0.820},{"interface":"front","average":{"1min":1.133,"5min":1.140,"15min":1.136},"min":{"1min":0.601,"5min":0.601,"15min":0.601},"max":{"1min":3.438,"5min":3.438,"15min":3.438},"last":1.144}]},{"osd":2,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.158,"5min":1.122,"15min":1.120},"min":{"1min":0.527,"5min":0.527,"15min":0.527},"max":{"1min":2.248,"5min":2.248,"15min":2.248},"last":1.050},{"interface":"front","average":{"1min":1.212,"5min":1.238,"15min":1.219},"min":{"1min":0.579,"5min":0.579,"15min":0.579},"max":{"1min":2.000,"5min":2.000,"15min":2.000},"last":1.084}]},{"osd":3,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.160,"15min":1.102},"min":{"1min":0.850,"5min":0.680,"15min":0.680},"max":{"1min":2.328,"5min":2.328,"15min":2.328},"last":1.021},{"interface":"front","average":{"1min":1.263,"5min":1.299,"15min":1.283},"min":{"1min":0.611,"5min":0.611,"15min":0.611},"max":{"1min":2.056,"5min":2.143,"15min":2.143},"last":0.669}]},{"osd":4,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":0.834,"5min":0.944,"15min":0.970},"min":{"1min":0.557,"5min":0.549,"15min":0.549},"max":{"1min":1.558,"5min":1.878,"15min":1.878},"last":0.598},{"interface":"front","average":{"1min":1.168,"5min":1.020,"15min":0.956},"min":{"1min":0.581,"5min":0.578,"15min":0.578},"max":{"1min":2.106,"5min":2.106,"15min":2.106},"last":1.188}]},{"osd":6,"last update":"Tue Dec 24 22:05:15 2019","interfaces":[{"interface":"back","average":{"1min":1.346,"5min":1.346,"15min":1.346},"min":{"1min":0.721,"5min":0.721,"15min":0.721},"max":{"1min":2.003,"5min":2.045,"15min":2.045},"last":0.944},{"interface":"front","average":{"1min":1.031,"5min":1.083,"15min":1.091},"min":{"1min":0.688,"5min":0.688,"15min":0.688},"max":{"1min":1.548,"5min":1.998,"15min":1.998},"last":0.732}]},{"osd":7,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.431,"15min":1.433},"min":{"1min":0.868,"5min":0.868,"15min":0.868},"max":{"1min":2.095,"5min":2.235,"15min":2.235},"last":0.993},{"interface":"front","average":{"1min":1.573,"5min":1.593,"15min":1.597},"min":{"1min":0.706,"5min":0.706,"15min":0.706},"max":{"1min":2.086,"5min":2.086,"15min":2.086},"last":1.290}]},{"osd":8,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.646,"5min":1.766,"15min":1.786},"min":{"1min":0.986,"5min":0.986,"15min":0.986},"max":{"1min":2.702,"5min":2.702,"15min":2.702},"last":1.732},{"interface":"front","average":{"1min":1.638,"5min":1.821,"15min":1.851},"min":{"1min":0.939,"5min":0.939,"15min":0.939},"max":{"1min":2.224,"5min":2.386,"15min":2.386},"last":1.673}]},{"osd":9,"last update":"Tue Dec 24 22:05:13 2019","interfaces":[{"interface":"back","average":{"1min":1.795,"5min":1.795,"15min":1.795},"min":{"1min":1.359,"5min":1.359,"15min":1.359},"max":{"1min":2.463,"5min":2.463,"15min":2.463},"last":1.604},{"interface":"front","average":{"1min":1.852,"5min":1.852,"15min":1.852},"min":{"1min":1.492,"5min":1.492,"15min":1.492},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":1.553}]},{"osd":10,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.735,"5min":1.735,"15min":1.735},"min":{"1min":1.214,"5min":1.214,"15min":1.214},"max":{"1min":2.640,"5min":2.640,"15min":2.640},"last":1.861},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":1.126,"5min":1.126,"15min":1.126},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.796}]}]}]}} 2019-12-24T22:06:18.937 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph pg dump --format=json 2019-12-24T22:06:21.210 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:06:21.210 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2019-12-24T22:06:21.762 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2019-12-24T22:06:20.082592+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":12,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1124941824,"kb_used":12590832,"kb_used_data":7824,"kb_used_omap":0,"kb_used_meta":12582912,"kb_avail":1112350992,"statfs":{"total":1151940427776,"available":1139047415808,"internally_reserved":12884901888,"allocated":8011776,"data_stored":3809544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12884901888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":11,"up_from":63,"seq":270582939669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.035,"5min":1.035,"15min":1.035},"min":{"1min":0.457,"5min":0.457,"15min":0.457},"max":{"1min":1.790,"5min":1.790,"15min":1.790},"last":0.869},{"interface":"front","average":{"1min":1.035,"5min":1.035,"15min":1.035},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.908,"5min":1.908,"15min":1.908},"last":1.320}]},{"osd":1,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.043,"5min":1.043,"15min":1.043},"min":{"1min":0.559,"5min":0.559,"15min":0.559},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":1.207},{"interface":"front","average":{"1min":0.920,"5min":0.920,"15min":0.920},"min":{"1min":0.591,"5min":0.591,"15min":0.591},"max":{"1min":1.539,"5min":1.539,"15min":1.539},"last":1.020}]},{"osd":2,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.946,"5min":0.946,"15min":0.946},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.059,"5min":2.059,"15min":2.059},"last":0.803},{"interface":"front","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.673,"5min":0.673,"15min":0.673},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.396}]},{"osd":3,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.140,"5min":1.140,"15min":1.140},"min":{"1min":0.518,"5min":0.518,"15min":0.518},"max":{"1min":2.138,"5min":2.138,"15min":2.138},"last":1.148},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.659,"5min":0.659,"15min":0.659},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.921}]},{"osd":4,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.965,"5min":0.965,"15min":0.965},"max":{"1min":2.013,"5min":2.013,"15min":2.013},"last":1.109},{"interface":"front","average":{"1min":1.260,"5min":1.260,"15min":1.260},"min":{"1min":0.786,"5min":0.786,"15min":0.786},"max":{"1min":2.197,"5min":2.197,"15min":2.197},"last":1.450}]},{"osd":5,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.533,"5min":1.533,"15min":1.533},"min":{"1min":1.098,"5min":1.098,"15min":1.098},"max":{"1min":2.455,"5min":2.455,"15min":2.455},"last":1.632},{"interface":"front","average":{"1min":1.350,"5min":1.350,"15min":1.350},"min":{"1min":0.674,"5min":0.674,"15min":0.674},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.366}]},{"osd":6,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.362,"5min":1.362,"15min":1.362},"min":{"1min":0.883,"5min":0.883,"15min":0.883},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.512},{"interface":"front","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":1.289,"5min":1.289,"15min":1.289},"max":{"1min":2.778,"5min":2.778,"15min":2.778},"last":1.537}]},{"osd":7,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":1.112,"5min":1.112,"15min":1.112},"max":{"1min":2.337,"5min":2.337,"15min":2.337},"last":1.593},{"interface":"front","average":{"1min":1.640,"5min":1.640,"15min":1.640},"min":{"1min":1.169,"5min":1.169,"15min":1.169},"max":{"1min":2.897,"5min":2.897,"15min":2.897},"last":1.734}]},{"osd":8,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.432,"5min":1.432,"15min":1.432},"min":{"1min":0.849,"5min":0.849,"15min":0.849},"max":{"1min":1.834,"5min":1.834,"15min":1.834},"last":1.275},{"interface":"front","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":1.076,"5min":1.076,"15min":1.076},"max":{"1min":3.173,"5min":3.173,"15min":3.173},"last":1.684}]},{"osd":10,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.461,"5min":1.461,"15min":1.461},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":1.808,"5min":1.808,"15min":1.808},"last":1.490},{"interface":"front","average":{"1min":1.701,"5min":1.701,"15min":1.701},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.985,"5min":2.985,"15min":2.985},"last":1.789}]}]},{"osd":10,"up_from":58,"seq":249108103193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.804}]},{"osd":1,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":0.965,"5min":0.965,"15min":0.965},"min":{"1min":0.573,"5min":0.573,"15min":0.573},"max":{"1min":1.612,"5min":1.612,"15min":1.612},"last":1.361},{"interface":"front","average":{"1min":0.963,"5min":0.963,"15min":0.963},"min":{"1min":0.612,"5min":0.612,"15min":0.612},"max":{"1min":1.410,"5min":1.410,"15min":1.410},"last":1.151}]},{"osd":2,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":0.985,"5min":0.985,"15min":0.985},"min":{"1min":0.575,"5min":0.575,"15min":0.575},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.678},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.645,"5min":0.645,"15min":0.645},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.736}]},{"osd":3,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.358,"5min":1.358,"15min":1.358},"min":{"1min":0.579,"5min":0.579,"15min":0.579},"max":{"1min":8.538,"5min":8.538,"15min":8.538},"last":1.237},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.655,"5min":0.655,"15min":0.655},"max":{"1min":8.477,"5min":8.477,"15min":8.477},"last":0.881}]},{"osd":4,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.328,"5min":1.328,"15min":1.328},"min":{"1min":0.802,"5min":0.802,"15min":0.802},"max":{"1min":1.815,"5min":1.815,"15min":1.815},"last":1.446},{"interface":"front","average":{"1min":1.350,"5min":1.350,"15min":1.350},"min":{"1min":0.882,"5min":0.882,"15min":0.882},"max":{"1min":1.880,"5min":1.880,"15min":1.880},"last":1.474}]},{"osd":5,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.382,"5min":1.382,"15min":1.382},"min":{"1min":0.848,"5min":0.848,"15min":0.848},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":1.518},{"interface":"front","average":{"1min":1.396,"5min":1.396,"15min":1.396},"min":{"1min":0.980,"5min":0.980,"15min":0.980},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.293}]},{"osd":6,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.750,"5min":0.750,"15min":0.750},"max":{"1min":2.063,"5min":2.063,"15min":2.063},"last":1.022},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.838,"5min":0.838,"15min":0.838},"max":{"1min":2.025,"5min":2.025,"15min":2.025},"last":0.979}]},{"osd":7,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.279,"5min":2.279,"15min":2.279},"last":1.126},{"interface":"front","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":1.224,"5min":1.224,"15min":1.224},"max":{"1min":2.125,"5min":2.125,"15min":2.125},"last":1.320}]},{"osd":8,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.558,"5min":1.558,"15min":1.558},"min":{"1min":0.888,"5min":0.888,"15min":0.888},"max":{"1min":2.178,"5min":2.178,"15min":2.178},"last":0.788},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.757,"5min":0.757,"15min":0.757},"max":{"1min":2.007,"5min":2.007,"15min":2.007},"last":1.083}]},{"osd":9,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.578,"5min":1.578,"15min":1.578},"min":{"1min":0.616,"5min":0.616,"15min":0.616},"max":{"1min":2.446,"5min":2.446,"15min":2.446},"last":1.181},{"interface":"front","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.566,"5min":0.566,"15min":0.566},"max":{"1min":2.193,"5min":2.193,"15min":2.193},"last":0.944}]},{"osd":11,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.738,"5min":1.738,"15min":1.738},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.405},{"interface":"front","average":{"1min":1.588,"5min":1.588,"15min":1.588},"min":{"1min":1.143,"5min":1.143,"15min":1.143},"max":{"1min":2.123,"5min":2.123,"15min":2.123},"last":1.608}]}]},{"osd":9,"up_from":53,"seq":227633266716,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":0.887,"5min":0.915,"15min":0.920},"min":{"1min":0.585,"5min":0.475,"15min":0.475},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":0.948},{"interface":"front","average":{"1min":0.965,"5min":0.901,"15min":0.890},"min":{"1min":0.574,"5min":0.484,"15min":0.484},"max":{"1min":2.330,"5min":2.330,"15min":2.330},"last":0.878}]},{"osd":1,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":0.856,"5min":0.841,"15min":0.839},"min":{"1min":0.562,"5min":0.562,"15min":0.562},"max":{"1min":1.482,"5min":1.660,"15min":1.660},"last":0.909},{"interface":"front","average":{"1min":1.124,"5min":1.098,"15min":1.094},"min":{"1min":0.785,"5min":0.674,"15min":0.674},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":1.115}]},{"osd":2,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.054,"15min":1.051},"min":{"1min":0.689,"5min":0.536,"15min":0.536},"max":{"1min":1.731,"5min":1.731,"15min":1.731},"last":0.696},{"interface":"front","average":{"1min":0.962,"5min":1.055,"15min":1.071},"min":{"1min":0.540,"5min":0.540,"15min":0.540},"max":{"1min":2.064,"5min":2.064,"15min":2.064},"last":1.075}]},{"osd":3,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.287,"5min":1.259,"15min":1.254},"min":{"1min":0.608,"5min":0.608,"15min":0.608},"max":{"1min":1.803,"5min":1.803,"15min":1.803},"last":0.794},{"interface":"front","average":{"1min":1.219,"5min":1.133,"15min":1.119},"min":{"1min":0.648,"5min":0.627,"15min":0.627},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":1.196}]},{"osd":4,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.142,"5min":0.965,"15min":0.935},"min":{"1min":0.742,"5min":0.484,"15min":0.484},"max":{"1min":1.842,"5min":1.842,"15min":1.842},"last":1.152},{"interface":"front","average":{"1min":1.480,"5min":1.348,"15min":1.326},"min":{"1min":0.872,"5min":0.803,"15min":0.803},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.296}]},{"osd":5,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.283,"5min":1.271,"15min":1.269},"min":{"1min":0.921,"5min":0.781,"15min":0.781},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":0.989},{"interface":"front","average":{"1min":1.228,"5min":1.127,"15min":1.110},"min":{"1min":1.003,"5min":0.843,"15min":0.843},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":1.034}]},{"osd":6,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.457,"5min":1.323,"15min":1.301},"min":{"1min":1.099,"5min":0.907,"15min":0.907},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.270},{"interface":"front","average":{"1min":1.376,"5min":1.238,"15min":1.215},"min":{"1min":1.041,"5min":0.751,"15min":0.751},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.249}]},{"osd":7,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.448,"15min":1.424},"min":{"1min":1.013,"5min":0.891,"15min":0.891},"max":{"1min":2.047,"5min":2.047,"15min":2.047},"last":1.013},{"interface":"front","average":{"1min":1.531,"5min":1.455,"15min":1.442},"min":{"1min":1.145,"5min":0.723,"15min":0.723},"max":{"1min":2.134,"5min":2.134,"15min":2.134},"last":1.400}]},{"osd":8,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.392,"15min":1.368},"min":{"1min":1.038,"5min":0.555,"15min":0.555},"max":{"1min":2.212,"5min":2.212,"15min":2.212},"last":1.174},{"interface":"front","average":{"1min":1.616,"5min":1.417,"15min":1.384},"min":{"1min":1.192,"5min":0.605,"15min":0.605},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":1.331}]},{"osd":10,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.315,"5min":1.315,"15min":1.315},"min":{"1min":0.865,"5min":0.865,"15min":0.865},"max":{"1min":1.713,"5min":1.713,"15min":1.713},"last":0.736},{"interface":"front","average":{"1min":1.662,"5min":1.662,"15min":1.662},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":2.128,"5min":2.128,"15min":2.128},"last":1.368}]}]},{"osd":8,"up_from":48,"seq":206158430241,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.887,"5min":0.873,"15min":0.871},"min":{"1min":0.512,"5min":0.512,"15min":0.512},"max":{"1min":1.441,"5min":2.639,"15min":2.639},"last":0.989},{"interface":"front","average":{"1min":0.795,"5min":0.792,"15min":0.792},"min":{"1min":0.480,"5min":0.480,"15min":0.480},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.758}]},{"osd":1,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.983,"5min":1.044,"15min":1.054},"min":{"1min":0.585,"5min":0.585,"15min":0.585},"max":{"1min":1.346,"5min":1.864,"15min":1.864},"last":1.262},{"interface":"front","average":{"1min":1.007,"5min":1.123,"15min":1.142},"min":{"1min":0.470,"5min":0.470,"15min":0.470},"max":{"1min":1.620,"5min":2.751,"15min":2.751},"last":0.694}]},{"osd":2,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.897,"5min":0.953,"15min":0.962},"min":{"1min":0.579,"5min":0.579,"15min":0.579},"max":{"1min":1.315,"5min":1.581,"15min":1.581},"last":1.046},{"interface":"front","average":{"1min":1.043,"5min":1.039,"15min":1.039},"min":{"1min":0.550,"5min":0.550,"15min":0.550},"max":{"1min":1.542,"5min":1.813,"15min":1.813},"last":0.799}]},{"osd":3,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.961,"5min":0.969,"15min":0.971},"min":{"1min":0.567,"5min":0.563,"15min":0.563},"max":{"1min":1.448,"5min":1.669,"15min":1.669},"last":1.527},{"interface":"front","average":{"1min":1.168,"5min":1.140,"15min":1.135},"min":{"1min":0.631,"5min":0.631,"15min":0.631},"max":{"1min":1.558,"5min":2.925,"15min":2.925},"last":1.097}]},{"osd":4,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.194,"15min":1.188},"min":{"1min":0.866,"5min":0.659,"15min":0.659},"max":{"1min":1.567,"5min":2.839,"15min":2.839},"last":1.172},{"interface":"front","average":{"1min":0.991,"5min":1.067,"15min":1.079},"min":{"1min":0.748,"5min":0.726,"15min":0.726},"max":{"1min":1.284,"5min":1.617,"15min":1.617},"last":1.142}]},{"osd":5,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.357,"15min":1.355},"min":{"1min":1.056,"5min":0.958,"15min":0.958},"max":{"1min":1.876,"5min":1.916,"15min":1.916},"last":1.383},{"interface":"front","average":{"1min":1.576,"5min":1.510,"15min":1.499},"min":{"1min":1.034,"5min":1.008,"15min":1.008},"max":{"1min":1.863,"5min":3.434,"15min":3.434},"last":1.348}]},{"osd":6,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.200,"15min":1.194},"min":{"1min":0.769,"5min":0.769,"15min":0.769},"max":{"1min":1.723,"5min":1.723,"15min":1.723},"last":1.226},{"interface":"front","average":{"1min":1.435,"5min":1.390,"15min":1.382},"min":{"1min":1.018,"5min":0.862,"15min":0.862},"max":{"1min":1.880,"5min":2.141,"15min":2.141},"last":1.417}]},{"osd":7,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.465,"5min":1.493,"15min":1.498},"min":{"1min":0.972,"5min":0.897,"15min":0.897},"max":{"1min":1.770,"5min":3.335,"15min":3.335},"last":1.456},{"interface":"front","average":{"1min":1.311,"5min":1.335,"15min":1.339},"min":{"1min":0.897,"5min":0.897,"15min":0.897},"max":{"1min":1.509,"5min":1.845,"15min":1.845},"last":1.631}]},{"osd":9,"last update":"Tue Dec 24 22:06:17 2019","interfaces":[{"interface":"back","average":{"1min":1.311,"5min":1.329,"15min":1.332},"min":{"1min":0.877,"5min":0.523,"15min":0.523},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.501},{"interface":"front","average":{"1min":1.332,"5min":1.289,"15min":1.282},"min":{"1min":0.797,"5min":0.693,"15min":0.693},"max":{"1min":1.729,"5min":1.747,"15min":1.747},"last":1.670}]},{"osd":10,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.390,"5min":1.390,"15min":1.390},"min":{"1min":0.854,"5min":0.854,"15min":0.854},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.564},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.705,"5min":0.705,"15min":0.705},"max":{"1min":2.257,"5min":2.257,"15min":2.257},"last":1.595}]}]},{"osd":7,"up_from":43,"seq":184683593765,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.142,"15min":1.152},"min":{"1min":0.701,"5min":0.701,"15min":0.701},"max":{"1min":1.766,"5min":2.044,"15min":2.044},"last":0.973},{"interface":"front","average":{"1min":1.085,"5min":1.129,"15min":1.136},"min":{"1min":0.652,"5min":0.630,"15min":0.630},"max":{"1min":1.942,"5min":1.954,"15min":1.954},"last":1.513}]},{"osd":1,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.186,"5min":1.015,"15min":0.987},"min":{"1min":0.686,"5min":0.567,"15min":0.567},"max":{"1min":1.688,"5min":1.688,"15min":1.688},"last":0.828},{"interface":"front","average":{"1min":1.193,"5min":1.077,"15min":1.057},"min":{"1min":0.612,"5min":0.612,"15min":0.612},"max":{"1min":1.945,"5min":1.945,"15min":1.945},"last":1.100}]},{"osd":2,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.253,"5min":1.104,"15min":1.079},"min":{"1min":0.829,"5min":0.646,"15min":0.646},"max":{"1min":1.880,"5min":2.181,"15min":2.181},"last":0.696},{"interface":"front","average":{"1min":1.137,"5min":1.133,"15min":1.132},"min":{"1min":0.780,"5min":0.592,"15min":0.592},"max":{"1min":1.813,"5min":1.813,"15min":1.813},"last":0.767}]},{"osd":3,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.185,"5min":1.135,"15min":1.127},"min":{"1min":0.684,"5min":0.636,"15min":0.636},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.893},{"interface":"front","average":{"1min":1.102,"5min":1.113,"15min":1.115},"min":{"1min":0.794,"5min":0.772,"15min":0.772},"max":{"1min":1.444,"5min":1.759,"15min":1.759},"last":1.170}]},{"osd":4,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":0.917,"5min":1.057,"15min":1.081},"min":{"1min":0.511,"5min":0.494,"15min":0.494},"max":{"1min":1.403,"5min":2.270,"15min":2.270},"last":1.224},{"interface":"front","average":{"1min":1.004,"5min":1.118,"15min":1.137},"min":{"1min":0.703,"5min":0.703,"15min":0.703},"max":{"1min":1.603,"5min":1.815,"15min":1.815},"last":0.932}]},{"osd":5,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.357,"15min":1.363},"min":{"1min":0.723,"5min":0.723,"15min":0.723},"max":{"1min":1.878,"5min":2.144,"15min":2.144},"last":1.262},{"interface":"front","average":{"1min":1.459,"5min":1.373,"15min":1.359},"min":{"1min":0.824,"5min":0.638,"15min":0.638},"max":{"1min":2.150,"5min":2.412,"15min":2.412},"last":1.723}]},{"osd":6,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.497,"15min":1.515},"min":{"1min":0.869,"5min":0.869,"15min":0.869},"max":{"1min":2.447,"5min":2.668,"15min":2.668},"last":1.305},{"interface":"front","average":{"1min":1.479,"5min":1.437,"15min":1.430},"min":{"1min":0.851,"5min":0.851,"15min":0.851},"max":{"1min":2.011,"5min":2.039,"15min":2.039},"last":1.813}]},{"osd":8,"last update":"Tue Dec 24 22:06:03 2019","interfaces":[{"interface":"back","average":{"1min":1.563,"5min":1.631,"15min":1.643},"min":{"1min":0.825,"5min":0.825,"15min":0.825},"max":{"1min":2.549,"5min":2.549,"15min":2.549},"last":1.406},{"interface":"front","average":{"1min":1.528,"5min":1.608,"15min":1.621},"min":{"1min":0.965,"5min":0.965,"15min":0.965},"max":{"1min":2.215,"5min":2.442,"15min":2.442},"last":1.868}]},{"osd":9,"last update":"Tue Dec 24 22:06:16 2019","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.678,"15min":1.693},"min":{"1min":1.158,"5min":1.136,"15min":1.136},"max":{"1min":2.033,"5min":2.558,"15min":2.558},"last":1.453},{"interface":"front","average":{"1min":1.628,"5min":1.756,"15min":1.777},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":2.183,"5min":2.398,"15min":2.398},"last":1.916}]},{"osd":10,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.727,"5min":1.727,"15min":1.727},"min":{"1min":1.379,"5min":1.379,"15min":1.379},"max":{"1min":2.372,"5min":2.372,"15min":2.372},"last":1.650},{"interface":"front","average":{"1min":1.739,"5min":1.739,"15min":1.739},"min":{"1min":1.304,"5min":1.304,"15min":1.304},"max":{"1min":2.289,"5min":2.289,"15min":2.289},"last":1.565}]}]},{"osd":6,"up_from":38,"seq":163208757289,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:18 2019","interfaces":[{"interface":"back","average":{"1min":0.958,"5min":0.994,"15min":1.000},"min":{"1min":0.659,"5min":0.462,"15min":0.462},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.867},{"interface":"front","average":{"1min":0.935,"5min":0.979,"15min":0.986},"min":{"1min":0.548,"5min":0.548,"15min":0.548},"max":{"1min":1.550,"5min":1.737,"15min":1.737},"last":0.699}]},{"osd":1,"last update":"Tue Dec 24 22:05:18 2019","interfaces":[{"interface":"back","average":{"1min":1.348,"5min":1.009,"15min":0.953},"min":{"1min":0.684,"5min":0.574,"15min":0.574},"max":{"1min":7.126,"5min":7.126,"15min":7.126},"last":0.754},{"interface":"front","average":{"1min":1.421,"5min":1.066,"15min":1.007},"min":{"1min":0.731,"5min":0.677,"15min":0.677},"max":{"1min":7.085,"5min":7.085,"15min":7.085},"last":1.031}]},{"osd":2,"last update":"Tue Dec 24 22:05:18 2019","interfaces":[{"interface":"back","average":{"1min":1.136,"5min":1.115,"15min":1.111},"min":{"1min":0.688,"5min":0.688,"15min":0.688},"max":{"1min":1.762,"5min":1.941,"15min":1.941},"last":1.293},{"interface":"front","average":{"1min":1.118,"5min":1.170,"15min":1.179},"min":{"1min":0.730,"5min":0.608,"15min":0.608},"max":{"1min":1.458,"5min":2.626,"15min":2.626},"last":1.401}]},{"osd":3,"last update":"Tue Dec 24 22:05:18 2019","interfaces":[{"interface":"back","average":{"1min":1.100,"5min":1.056,"15min":1.049},"min":{"1min":0.737,"5min":0.737,"15min":0.737},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.164},{"interface":"front","average":{"1min":0.965,"5min":1.137,"15min":1.165},"min":{"1min":0.591,"5min":0.591,"15min":0.591},"max":{"1min":1.619,"5min":1.646,"15min":1.646},"last":0.653}]},{"osd":4,"last update":"Tue Dec 24 22:05:18 2019","interfaces":[{"interface":"back","average":{"1min":1.126,"5min":1.123,"15min":1.123},"min":{"1min":0.807,"5min":0.485,"15min":0.485},"max":{"1min":1.473,"5min":1.724,"15min":1.724},"last":1.246},{"interface":"front","average":{"1min":1.212,"5min":1.206,"15min":1.205},"min":{"1min":0.814,"5min":0.700,"15min":0.700},"max":{"1min":1.555,"5min":2.005,"15min":2.005},"last":0.971}]},{"osd":5,"last update":"Tue Dec 24 22:05:18 2019","interfaces":[{"interface":"back","average":{"1min":1.352,"5min":1.327,"15min":1.323},"min":{"1min":0.934,"5min":0.620,"15min":0.620},"max":{"1min":2.033,"5min":2.033,"15min":2.033},"last":0.808},{"interface":"front","average":{"1min":1.324,"5min":1.350,"15min":1.354},"min":{"1min":0.614,"5min":0.614,"15min":0.614},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.109}]},{"osd":7,"last update":"Tue Dec 24 22:05:38 2019","interfaces":[{"interface":"back","average":{"1min":1.186,"5min":1.318,"15min":1.340},"min":{"1min":0.779,"5min":0.681,"15min":0.681},"max":{"1min":1.512,"5min":1.948,"15min":1.948},"last":1.080},{"interface":"front","average":{"1min":1.405,"5min":1.401,"15min":1.400},"min":{"1min":1.013,"5min":0.708,"15min":0.708},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":1.354}]},{"osd":8,"last update":"Tue Dec 24 22:05:58 2019","interfaces":[{"interface":"back","average":{"1min":1.615,"5min":1.699,"15min":1.713},"min":{"1min":1.200,"5min":1.200,"15min":1.200},"max":{"1min":2.000,"5min":2.450,"15min":2.450},"last":1.658},{"interface":"front","average":{"1min":1.517,"5min":1.655,"15min":1.678},"min":{"1min":1.236,"5min":1.236,"15min":1.236},"max":{"1min":1.937,"5min":2.224,"15min":2.224},"last":1.209}]},{"osd":9,"last update":"Tue Dec 24 22:06:18 2019","interfaces":[{"interface":"back","average":{"1min":1.757,"5min":1.795,"15min":1.801},"min":{"1min":1.480,"5min":1.426,"15min":1.426},"max":{"1min":2.197,"5min":2.282,"15min":2.282},"last":1.781},{"interface":"front","average":{"1min":1.654,"5min":1.683,"15min":1.688},"min":{"1min":1.339,"5min":1.115,"15min":1.115},"max":{"1min":2.808,"5min":2.808,"15min":2.808},"last":1.908}]},{"osd":10,"last update":"Tue Dec 24 22:05:38 2019","interfaces":[{"interface":"back","average":{"1min":1.814,"5min":1.814,"15min":1.814},"min":{"1min":1.465,"5min":1.465,"15min":1.465},"max":{"1min":2.603,"5min":2.603,"15min":2.603},"last":1.807},{"interface":"front","average":{"1min":1.699,"5min":1.699,"15min":1.699},"min":{"1min":1.314,"5min":1.314,"15min":1.314},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.727}]}]},{"osd":1,"up_from":12,"seq":51539607613,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:37 2019","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.748,"15min":0.670},"min":{"1min":0.611,"5min":0.406,"15min":0.406},"max":{"1min":1.267,"5min":1.491,"15min":1.491},"last":1.101},{"interface":"front","average":{"1min":0.839,"5min":0.777,"15min":0.745},"min":{"1min":0.539,"5min":0.285,"15min":0.285},"max":{"1min":1.340,"5min":1.701,"15min":1.701},"last":0.615}]},{"osd":2,"last update":"Tue Dec 24 22:06:00 2019","interfaces":[{"interface":"back","average":{"1min":0.812,"5min":0.830,"15min":0.787},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.626,"5min":1.626,"15min":1.626},"last":0.573},{"interface":"front","average":{"1min":0.926,"5min":0.789,"15min":0.772},"min":{"1min":0.538,"5min":0.538,"15min":0.538},"max":{"1min":2.075,"5min":2.075,"15min":2.075},"last":1.311}]},{"osd":3,"last update":"Tue Dec 24 22:06:14 2019","interfaces":[{"interface":"back","average":{"1min":0.919,"5min":0.902,"15min":0.819},"min":{"1min":0.521,"5min":0.515,"15min":0.515},"max":{"1min":1.728,"5min":1.866,"15min":1.866},"last":0.719},{"interface":"front","average":{"1min":1.112,"5min":1.042,"15min":0.983},"min":{"1min":0.508,"5min":0.508,"15min":0.508},"max":{"1min":2.152,"5min":2.152,"15min":2.152},"last":0.786}]},{"osd":4,"last update":"Tue Dec 24 22:05:37 2019","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.981,"15min":0.951},"min":{"1min":0.624,"5min":0.585,"15min":0.585},"max":{"1min":1.740,"5min":1.740,"15min":1.740},"last":0.948},{"interface":"front","average":{"1min":1.252,"5min":1.098,"15min":1.051},"min":{"1min":0.831,"5min":0.701,"15min":0.701},"max":{"1min":1.747,"5min":1.843,"15min":1.843},"last":0.875}]},{"osd":5,"last update":"Tue Dec 24 22:06:00 2019","interfaces":[{"interface":"back","average":{"1min":1.289,"5min":1.283,"15min":1.309},"min":{"1min":0.829,"5min":0.733,"15min":0.733},"max":{"1min":2.551,"5min":2.551,"15min":2.551},"last":1.791},{"interface":"front","average":{"1min":1.471,"5min":1.153,"15min":1.005},"min":{"1min":0.921,"5min":0.619,"15min":0.619},"max":{"1min":2.243,"5min":2.243,"15min":2.243},"last":1.272}]},{"osd":6,"last update":"Tue Dec 24 22:05:17 2019","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.225,"15min":1.193},"min":{"1min":0.618,"5min":0.618,"15min":0.618},"max":{"1min":2.079,"5min":2.079,"15min":2.079},"last":1.172},{"interface":"front","average":{"1min":1.560,"5min":1.495,"15min":1.484},"min":{"1min":0.802,"5min":0.802,"15min":0.802},"max":{"1min":2.358,"5min":2.358,"15min":2.358},"last":1.041}]},{"osd":7,"last update":"Tue Dec 24 22:05:37 2019","interfaces":[{"interface":"back","average":{"1min":1.485,"5min":1.359,"15min":1.338},"min":{"1min":0.972,"5min":0.970,"15min":0.970},"max":{"1min":2.212,"5min":2.212,"15min":2.212},"last":1.244},{"interface":"front","average":{"1min":1.643,"5min":1.569,"15min":1.557},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":2.475,"5min":2.475,"15min":2.475},"last":1.202}]},{"osd":8,"last update":"Tue Dec 24 22:06:00 2019","interfaces":[{"interface":"back","average":{"1min":1.582,"5min":1.633,"15min":1.641},"min":{"1min":1.093,"5min":1.093,"15min":1.093},"max":{"1min":2.716,"5min":2.716,"15min":2.716},"last":1.917},{"interface":"front","average":{"1min":1.528,"5min":1.660,"15min":1.682},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":2.032,"5min":2.556,"15min":2.556},"last":1.391}]},{"osd":9,"last update":"Tue Dec 24 22:06:14 2019","interfaces":[{"interface":"back","average":{"1min":1.683,"5min":1.508,"15min":1.479},"min":{"1min":0.985,"5min":0.985,"15min":0.985},"max":{"1min":2.631,"5min":2.631,"15min":2.631},"last":2.034},{"interface":"front","average":{"1min":1.650,"5min":1.704,"15min":1.713},"min":{"1min":1.083,"5min":1.083,"15min":1.083},"max":{"1min":2.319,"5min":2.621,"15min":2.621},"last":1.419}]},{"osd":10,"last update":"Tue Dec 24 22:05:37 2019","interfaces":[{"interface":"back","average":{"1min":1.500,"5min":1.500,"15min":1.500},"min":{"1min":1.125,"5min":1.125,"15min":1.125},"max":{"1min":2.180,"5min":2.180,"15min":2.180},"last":1.975},{"interface":"front","average":{"1min":1.705,"5min":1.705,"15min":1.705},"min":{"1min":1.237,"5min":1.237,"15min":1.237},"max":{"1min":2.759,"5min":2.759,"15min":2.759},"last":1.362}]}]},{"osd":0,"up_from":7,"seq":30064771137,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 24 22:05:40 2019","interfaces":[{"interface":"back","average":{"1min":0.799,"5min":0.651,"15min":0.578},"min":{"1min":0.465,"5min":0.355,"15min":0.355},"max":{"1min":1.568,"5min":1.568,"15min":1.568},"last":1.175},{"interface":"front","average":{"1min":0.903,"5min":0.782,"15min":0.672},"min":{"1min":0.478,"5min":0.437,"15min":0.437},"max":{"1min":1.428,"5min":1.505,"15min":1.505},"last":0.637}]},{"osd":2,"last update":"Tue Dec 24 22:03:53 2019","interfaces":[{"interface":"back","average":{"1min":0.700,"5min":0.667,"15min":0.661},"min":{"1min":0.512,"5min":0.371,"15min":0.371},"max":{"1min":0.944,"5min":0.944,"15min":0.944},"last":0.545},{"interface":"front","average":{"1min":0.927,"5min":0.779,"15min":0.755},"min":{"1min":0.614,"5min":0.452,"15min":0.452},"max":{"1min":1.197,"5min":1.197,"15min":1.197},"last":0.705}]},{"osd":3,"last update":"Tue Dec 24 22:05:16 2019","interfaces":[{"interface":"back","average":{"1min":1.122,"5min":0.874,"15min":0.804},"min":{"1min":0.623,"5min":0.508,"15min":0.508},"max":{"1min":2.013,"5min":2.013,"15min":2.013},"last":1.309},{"interface":"front","average":{"1min":0.908,"5min":0.860,"15min":0.847},"min":{"1min":0.489,"5min":0.489,"15min":0.489},"max":{"1min":1.580,"5min":1.580,"15min":1.580},"last":0.711}]},{"osd":4,"last update":"Tue Dec 24 22:05:40 2019","interfaces":[{"interface":"back","average":{"1min":0.963,"5min":1.045,"15min":1.046},"min":{"1min":0.671,"5min":0.571,"15min":0.571},"max":{"1min":1.496,"5min":1.577,"15min":1.577},"last":0.807},{"interface":"front","average":{"1min":1.349,"5min":1.191,"15min":1.122},"min":{"1min":0.849,"5min":0.707,"15min":0.707},"max":{"1min":1.930,"5min":1.930,"15min":1.930},"last":1.806}]},{"osd":5,"last update":"Tue Dec 24 22:05:58 2019","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.121,"15min":1.128},"min":{"1min":0.549,"5min":0.549,"15min":0.549},"max":{"1min":1.702,"5min":2.085,"15min":2.085},"last":0.921},{"interface":"front","average":{"1min":1.378,"5min":1.264,"15min":1.192},"min":{"1min":0.910,"5min":0.887,"15min":0.887},"max":{"1min":2.325,"5min":2.325,"15min":2.325},"last":1.882}]},{"osd":6,"last update":"Tue Dec 24 22:05:16 2019","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.221,"15min":1.209},"min":{"1min":0.709,"5min":0.709,"15min":0.709},"max":{"1min":2.019,"5min":2.019,"15min":2.019},"last":1.102},{"interface":"front","average":{"1min":1.341,"5min":1.335,"15min":1.334},"min":{"1min":0.846,"5min":0.832,"15min":0.832},"max":{"1min":1.882,"5min":1.970,"15min":1.970},"last":1.046}]},{"osd":7,"last update":"Tue Dec 24 22:05:40 2019","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.307,"15min":1.321},"min":{"1min":0.750,"5min":0.750,"15min":0.750},"max":{"1min":2.114,"5min":2.114,"15min":2.114},"last":1.392},{"interface":"front","average":{"1min":1.411,"5min":1.432,"15min":1.436},"min":{"1min":0.774,"5min":0.774,"15min":0.774},"max":{"1min":2.231,"5min":2.231,"15min":2.231},"last":1.977}]},{"osd":8,"last update":"Tue Dec 24 22:05:58 2019","interfaces":[{"interface":"back","average":{"1min":1.567,"5min":1.656,"15min":1.671},"min":{"1min":1.030,"5min":1.030,"15min":1.030},"max":{"1min":3.015,"5min":3.015,"15min":3.015},"last":2.110},{"interface":"front","average":{"1min":1.444,"5min":1.484,"15min":1.490},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.771,"5min":2.771,"15min":2.771},"last":1.148}]},{"osd":9,"last update":"Tue Dec 24 22:05:16 2019","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.613,"15min":1.613},"min":{"1min":0.712,"5min":0.712,"15min":0.712},"max":{"1min":2.652,"5min":2.652,"15min":2.652},"last":2.166},{"interface":"front","average":{"1min":1.467,"5min":1.467,"15min":1.467},"min":{"1min":0.792,"5min":0.792,"15min":0.792},"max":{"1min":2.175,"5min":2.175,"15min":2.175},"last":1.470}]},{"osd":10,"last update":"Tue Dec 24 22:05:35 2019","interfaces":[{"interface":"back","average":{"1min":1.490,"5min":1.490,"15min":1.490},"min":{"1min":0.835,"5min":0.835,"15min":0.835},"max":{"1min":2.424,"5min":2.424,"15min":2.424},"last":1.254},{"interface":"front","average":{"1min":1.739,"5min":1.739,"15min":1.739},"min":{"1min":1.192,"5min":1.192,"15min":1.192},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":2.034}]},{"osd":11,"last update":"Tue Dec 24 22:05:53 2019","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.986,"5min":0.986,"15min":0.986},"max":{"1min":2.571,"5min":2.571,"15min":2.571},"last":1.576},{"interface":"front","average":{"1min":1.864,"5min":1.864,"15min":1.864},"min":{"1min":1.023,"5min":1.023,"15min":1.023},"max":{"1min":9.942,"5min":9.942,"15min":9.942},"last":1.436}]}]},{"osd":2,"up_from":17,"seq":73014444088,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:06:02 2019","interfaces":[{"interface":"back","average":{"1min":0.851,"5min":0.717,"15min":0.651},"min":{"1min":0.440,"5min":0.409,"15min":0.409},"max":{"1min":1.481,"5min":1.481,"15min":1.481},"last":0.659},{"interface":"front","average":{"1min":0.813,"5min":0.771,"15min":0.735},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.950}]},{"osd":1,"last update":"Tue Dec 24 22:06:02 2019","interfaces":[{"interface":"back","average":{"1min":0.840,"5min":0.741,"15min":0.685},"min":{"1min":0.510,"5min":0.448,"15min":0.448},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.741},{"interface":"front","average":{"1min":1.022,"5min":0.923,"15min":0.836},"min":{"1min":0.431,"5min":0.431,"15min":0.431},"max":{"1min":1.705,"5min":1.705,"15min":1.705},"last":1.155}]},{"osd":3,"last update":"Tue Dec 24 22:05:17 2019","interfaces":[{"interface":"back","average":{"1min":0.977,"5min":0.822,"15min":0.768},"min":{"1min":0.528,"5min":0.519,"15min":0.519},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.887},{"interface":"front","average":{"1min":1.143,"5min":0.896,"15min":0.841},"min":{"1min":0.598,"5min":0.513,"15min":0.513},"max":{"1min":1.549,"5min":1.549,"15min":1.549},"last":1.034}]},{"osd":4,"last update":"Tue Dec 24 22:05:38 2019","interfaces":[{"interface":"back","average":{"1min":1.037,"5min":0.967,"15min":0.940},"min":{"1min":0.597,"5min":0.494,"15min":0.494},"max":{"1min":1.971,"5min":1.973,"15min":1.973},"last":1.224},{"interface":"front","average":{"1min":1.140,"5min":1.069,"15min":1.045},"min":{"1min":0.551,"5min":0.551,"15min":0.551},"max":{"1min":1.615,"5min":2.039,"15min":2.039},"last":1.113}]},{"osd":5,"last update":"Tue Dec 24 22:06:02 2019","interfaces":[{"interface":"back","average":{"1min":1.539,"5min":1.253,"15min":1.161},"min":{"1min":0.912,"5min":0.788,"15min":0.788},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.280},{"interface":"front","average":{"1min":1.372,"5min":1.122,"15min":1.063},"min":{"1min":0.665,"5min":0.548,"15min":0.548},"max":{"1min":2.299,"5min":2.299,"15min":2.299},"last":1.356}]},{"osd":6,"last update":"Tue Dec 24 22:05:17 2019","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.215,"15min":1.163},"min":{"1min":0.824,"5min":0.816,"15min":0.816},"max":{"1min":2.366,"5min":2.366,"15min":2.366},"last":1.643},{"interface":"front","average":{"1min":1.283,"5min":1.390,"15min":1.408},"min":{"1min":0.680,"5min":0.680,"15min":0.680},"max":{"1min":2.777,"5min":2.777,"15min":2.777},"last":1.522}]},{"osd":7,"last update":"Tue Dec 24 22:05:36 2019","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.566,"15min":1.563},"min":{"1min":1.135,"5min":1.135,"15min":1.135},"max":{"1min":2.150,"5min":2.190,"15min":2.190},"last":1.585},{"interface":"front","average":{"1min":1.286,"5min":1.306,"15min":1.310},"min":{"1min":0.634,"5min":0.634,"15min":0.634},"max":{"1min":1.897,"5min":1.962,"15min":1.962},"last":1.495}]},{"osd":8,"last update":"Tue Dec 24 22:06:02 2019","interfaces":[{"interface":"back","average":{"1min":1.259,"5min":1.385,"15min":1.406},"min":{"1min":0.836,"5min":0.836,"15min":0.836},"max":{"1min":2.106,"5min":2.885,"15min":2.885},"last":1.328},{"interface":"front","average":{"1min":1.654,"5min":1.724,"15min":1.736},"min":{"1min":0.981,"5min":0.981,"15min":0.981},"max":{"1min":2.614,"5min":2.614,"15min":2.614},"last":1.449}]},{"osd":9,"last update":"Tue Dec 24 22:06:14 2019","interfaces":[{"interface":"back","average":{"1min":1.745,"5min":1.796,"15min":1.804},"min":{"1min":0.909,"5min":0.909,"15min":0.909},"max":{"1min":3.137,"5min":3.137,"15min":3.137},"last":1.710},{"interface":"front","average":{"1min":1.378,"5min":1.459,"15min":1.473},"min":{"1min":0.786,"5min":0.786,"15min":0.786},"max":{"1min":2.132,"5min":2.132,"15min":2.132},"last":1.558}]},{"osd":10,"last update":"Tue Dec 24 22:05:36 2019","interfaces":[{"interface":"back","average":{"1min":1.813,"5min":1.813,"15min":1.813},"min":{"1min":1.363,"5min":1.363,"15min":1.363},"max":{"1min":2.542,"5min":2.542,"15min":2.542},"last":1.760},{"interface":"front","average":{"1min":1.517,"5min":1.517,"15min":1.517},"min":{"1min":0.941,"5min":0.941,"15min":0.941},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.422}]}]},{"osd":3,"up_from":22,"seq":94489280564,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:04:18 2019","interfaces":[{"interface":"back","average":{"1min":0.605,"5min":0.621,"15min":0.623},"min":{"1min":0.400,"5min":0.400,"15min":0.400},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":1.050},{"interface":"front","average":{"1min":0.747,"5min":0.759,"15min":0.761},"min":{"1min":0.459,"5min":0.449,"15min":0.449},"max":{"1min":1.095,"5min":1.130,"15min":1.130},"last":1.150}]},{"osd":1,"last update":"Tue Dec 24 22:05:20 2019","interfaces":[{"interface":"back","average":{"1min":0.927,"5min":0.737,"15min":0.706},"min":{"1min":0.495,"5min":0.465,"15min":0.465},"max":{"1min":3.316,"5min":3.316,"15min":3.316},"last":0.731},{"interface":"front","average":{"1min":1.148,"5min":0.923,"15min":0.889},"min":{"1min":0.525,"5min":0.525,"15min":0.525},"max":{"1min":3.686,"5min":3.686,"15min":3.686},"last":0.786}]},{"osd":2,"last update":"Tue Dec 24 22:05:20 2019","interfaces":[{"interface":"back","average":{"1min":0.923,"5min":0.860,"15min":0.852},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.696,"5min":2.696,"15min":2.696},"last":0.656},{"interface":"front","average":{"1min":0.933,"5min":0.850,"15min":0.845},"min":{"1min":0.393,"5min":0.393,"15min":0.393},"max":{"1min":1.525,"5min":1.525,"15min":1.525},"last":1.001}]},{"osd":4,"last update":"Tue Dec 24 22:05:40 2019","interfaces":[{"interface":"back","average":{"1min":1.200,"5min":1.142,"15min":1.140},"min":{"1min":0.667,"5min":0.667,"15min":0.667},"max":{"1min":1.620,"5min":1.825,"15min":1.825},"last":0.959},{"interface":"front","average":{"1min":1.040,"5min":1.064,"15min":1.051},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.464}]},{"osd":5,"last update":"Tue Dec 24 22:05:54 2019","interfaces":[{"interface":"back","average":{"1min":1.428,"5min":1.294,"15min":1.237},"min":{"1min":0.806,"5min":0.806,"15min":0.806},"max":{"1min":2.799,"5min":2.799,"15min":2.799},"last":1.061},{"interface":"front","average":{"1min":1.292,"5min":1.210,"15min":1.167},"min":{"1min":0.743,"5min":0.731,"15min":0.731},"max":{"1min":2.624,"5min":2.624,"15min":2.624},"last":1.153}]},{"osd":6,"last update":"Tue Dec 24 22:05:20 2019","interfaces":[{"interface":"back","average":{"1min":1.408,"5min":1.320,"15min":1.306},"min":{"1min":0.732,"5min":0.732,"15min":0.732},"max":{"1min":3.034,"5min":3.034,"15min":3.034},"last":1.312},{"interface":"front","average":{"1min":1.370,"5min":1.266,"15min":1.248},"min":{"1min":0.917,"5min":0.861,"15min":0.861},"max":{"1min":2.370,"5min":2.370,"15min":2.370},"last":1.278}]},{"osd":7,"last update":"Tue Dec 24 22:05:40 2019","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.269,"15min":1.273},"min":{"1min":0.662,"5min":0.662,"15min":0.662},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":1.781},{"interface":"front","average":{"1min":1.683,"5min":1.520,"15min":1.493},"min":{"1min":0.707,"5min":0.707,"15min":0.707},"max":{"1min":3.368,"5min":3.368,"15min":3.368},"last":1.415}]},{"osd":8,"last update":"Tue Dec 24 22:05:54 2019","interfaces":[{"interface":"back","average":{"1min":1.580,"5min":1.690,"15min":1.708},"min":{"1min":0.639,"5min":0.639,"15min":0.639},"max":{"1min":3.927,"5min":3.927,"15min":3.927},"last":1.515},{"interface":"front","average":{"1min":1.308,"5min":1.380,"15min":1.392},"min":{"1min":0.785,"5min":0.785,"15min":0.785},"max":{"1min":2.430,"5min":2.430,"15min":2.430},"last":1.954}]},{"osd":9,"last update":"Tue Dec 24 22:05:14 2019","interfaces":[{"interface":"back","average":{"1min":1.820,"5min":1.820,"15min":1.820},"min":{"1min":0.982,"5min":0.982,"15min":0.982},"max":{"1min":3.583,"5min":3.583,"15min":3.583},"last":1.709},{"interface":"front","average":{"1min":1.589,"5min":1.589,"15min":1.589},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":2.914,"5min":2.914,"15min":2.914},"last":1.563}]},{"osd":10,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.862,"5min":1.862,"15min":1.862},"min":{"1min":1.110,"5min":1.110,"15min":1.110},"max":{"1min":3.759,"5min":3.759,"15min":3.759},"last":1.881},{"interface":"front","average":{"1min":1.572,"5min":1.572,"15min":1.572},"min":{"1min":0.855,"5min":0.855,"15min":0.855},"max":{"1min":3.187,"5min":3.187,"15min":3.187},"last":1.675}]},{"osd":11,"last update":"Tue Dec 24 22:05:54 2019","interfaces":[{"interface":"back","average":{"1min":1.666,"5min":1.666,"15min":1.666},"min":{"1min":1.074,"5min":1.074,"15min":1.074},"max":{"1min":2.540,"5min":2.540,"15min":2.540},"last":1.624},{"interface":"front","average":{"1min":1.602,"5min":1.602,"15min":1.602},"min":{"1min":0.866,"5min":0.866,"15min":0.866},"max":{"1min":4.079,"5min":4.079,"15min":4.079},"last":2.012}]}]},{"osd":4,"up_from":27,"seq":115964117041,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.156,"5min":0.984,"15min":0.924},"min":{"1min":0.641,"5min":0.441,"15min":0.441},"max":{"1min":2.050,"5min":2.050,"15min":2.050},"last":0.778},{"interface":"front","average":{"1min":0.933,"5min":1.052,"15min":1.080},"min":{"1min":0.637,"5min":0.584,"15min":0.584},"max":{"1min":1.418,"5min":1.653,"15min":1.653},"last":0.834}]},{"osd":1,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":0.902,"5min":0.909,"15min":0.903},"min":{"1min":0.602,"5min":0.592,"15min":0.592},"max":{"1min":1.795,"5min":1.795,"15min":1.795},"last":0.925},{"interface":"front","average":{"1min":1.297,"5min":1.185,"15min":1.149},"min":{"1min":0.574,"5min":0.574,"15min":0.574},"max":{"1min":1.946,"5min":2.229,"15min":2.229},"last":1.270}]},{"osd":2,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.098,"5min":0.998,"15min":0.952},"min":{"1min":0.676,"5min":0.550,"15min":0.550},"max":{"1min":1.862,"5min":2.144,"15min":2.144},"last":1.036},{"interface":"front","average":{"1min":1.096,"5min":1.048,"15min":1.050},"min":{"1min":0.748,"5min":0.564,"15min":0.564},"max":{"1min":1.481,"5min":1.821,"15min":1.821},"last":1.096}]},{"osd":3,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.358,"5min":1.124,"15min":1.068},"min":{"1min":0.714,"5min":0.637,"15min":0.637},"max":{"1min":1.799,"5min":1.799,"15min":1.799},"last":1.471},{"interface":"front","average":{"1min":1.313,"5min":1.042,"15min":0.969},"min":{"1min":0.975,"5min":0.585,"15min":0.585},"max":{"1min":1.655,"5min":1.852,"15min":1.852},"last":1.525}]},{"osd":5,"last update":"Tue Dec 24 22:06:09 2019","interfaces":[{"interface":"back","average":{"1min":1.251,"5min":1.132,"15min":1.055},"min":{"1min":0.645,"5min":0.510,"15min":0.510},"max":{"1min":1.773,"5min":2.081,"15min":2.081},"last":1.739},{"interface":"front","average":{"1min":1.165,"5min":1.131,"15min":1.125},"min":{"1min":0.644,"5min":0.557,"15min":0.557},"max":{"1min":1.601,"5min":2.611,"15min":2.611},"last":1.367}]},{"osd":6,"last update":"Tue Dec 24 22:05:17 2019","interfaces":[{"interface":"back","average":{"1min":1.457,"5min":1.296,"15min":1.269},"min":{"1min":1.008,"5min":0.576,"15min":0.576},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.634},{"interface":"front","average":{"1min":1.158,"5min":1.145,"15min":1.143},"min":{"1min":0.820,"5min":0.768,"15min":0.768},"max":{"1min":2.187,"5min":2.187,"15min":2.187},"last":1.200}]},{"osd":7,"last update":"Tue Dec 24 22:05:38 2019","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.356,"15min":1.366},"min":{"1min":0.690,"5min":0.663,"15min":0.663},"max":{"1min":1.833,"5min":1.916,"15min":1.916},"last":2.006},{"interface":"front","average":{"1min":1.324,"5min":1.341,"15min":1.344},"min":{"1min":1.049,"5min":1.042,"15min":1.042},"max":{"1min":1.714,"5min":2.336,"15min":2.336},"last":1.681}]},{"osd":8,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.692,"5min":1.742,"15min":1.750},"min":{"1min":1.262,"5min":1.245,"15min":1.245},"max":{"1min":2.341,"5min":2.341,"15min":2.341},"last":1.894},{"interface":"front","average":{"1min":1.638,"5min":1.622,"15min":1.619},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":1.785}]},{"osd":9,"last update":"Tue Dec 24 22:06:13 2019","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.442,"15min":1.454},"min":{"1min":0.961,"5min":0.946,"15min":0.946},"max":{"1min":1.764,"5min":1.827,"15min":1.827},"last":1.437},{"interface":"front","average":{"1min":1.826,"5min":1.770,"15min":1.760},"min":{"1min":1.249,"5min":1.249,"15min":1.249},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":1.831}]},{"osd":10,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.563,"5min":1.563,"15min":1.563},"min":{"1min":1.089,"5min":1.089,"15min":1.089},"max":{"1min":1.902,"5min":1.902,"15min":1.902},"last":1.601},{"interface":"front","average":{"1min":1.893,"5min":1.893,"15min":1.893},"min":{"1min":1.447,"5min":1.447,"15min":1.447},"max":{"1min":2.356,"5min":2.356,"15min":2.356},"last":1.952}]}]},{"osd":5,"up_from":32,"seq":137438953517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:06:06 2019","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.888,"15min":0.830},"min":{"1min":0.630,"5min":0.466,"15min":0.466},"max":{"1min":2.180,"5min":2.180,"15min":2.180},"last":1.115},{"interface":"front","average":{"1min":1.187,"5min":1.031,"15min":0.982},"min":{"1min":0.796,"5min":0.613,"15min":0.613},"max":{"1min":2.320,"5min":2.320,"15min":2.320},"last":1.198}]},{"osd":1,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.057,"5min":1.069,"15min":1.075},"min":{"1min":0.554,"5min":0.554,"15min":0.554},"max":{"1min":1.864,"5min":1.864,"15min":1.864},"last":0.997},{"interface":"front","average":{"1min":1.133,"5min":1.140,"15min":1.136},"min":{"1min":0.601,"5min":0.601,"15min":0.601},"max":{"1min":3.438,"5min":3.438,"15min":3.438},"last":1.150}]},{"osd":2,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.158,"5min":1.122,"15min":1.120},"min":{"1min":0.527,"5min":0.527,"15min":0.527},"max":{"1min":2.248,"5min":2.248,"15min":2.248},"last":0.606},{"interface":"front","average":{"1min":1.212,"5min":1.238,"15min":1.219},"min":{"1min":0.579,"5min":0.579,"15min":0.579},"max":{"1min":2.000,"5min":2.000,"15min":2.000},"last":1.242}]},{"osd":3,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.160,"15min":1.102},"min":{"1min":0.850,"5min":0.680,"15min":0.680},"max":{"1min":2.328,"5min":2.328,"15min":2.328},"last":0.891},{"interface":"front","average":{"1min":1.263,"5min":1.299,"15min":1.283},"min":{"1min":0.611,"5min":0.611,"15min":0.611},"max":{"1min":2.056,"5min":2.143,"15min":2.143},"last":0.949}]},{"osd":4,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":0.834,"5min":0.944,"15min":0.970},"min":{"1min":0.557,"5min":0.549,"15min":0.549},"max":{"1min":1.558,"5min":1.878,"15min":1.878},"last":0.780},{"interface":"front","average":{"1min":1.168,"5min":1.020,"15min":0.956},"min":{"1min":0.581,"5min":0.578,"15min":0.578},"max":{"1min":2.106,"5min":2.106,"15min":2.106},"last":0.694}]},{"osd":6,"last update":"Tue Dec 24 22:06:16 2019","interfaces":[{"interface":"back","average":{"1min":1.152,"5min":1.307,"15min":1.333},"min":{"1min":0.630,"5min":0.630,"15min":0.630},"max":{"1min":1.748,"5min":2.045,"15min":2.045},"last":1.324},{"interface":"front","average":{"1min":0.953,"5min":1.054,"15min":1.082},"min":{"1min":0.634,"5min":0.634,"15min":0.634},"max":{"1min":1.731,"5min":1.998,"15min":1.998},"last":1.034}]},{"osd":7,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.431,"15min":1.433},"min":{"1min":0.868,"5min":0.868,"15min":0.868},"max":{"1min":2.095,"5min":2.235,"15min":2.235},"last":1.384},{"interface":"front","average":{"1min":1.573,"5min":1.593,"15min":1.597},"min":{"1min":0.706,"5min":0.706,"15min":0.706},"max":{"1min":2.086,"5min":2.086,"15min":2.086},"last":1.422}]},{"osd":8,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.646,"5min":1.766,"15min":1.786},"min":{"1min":0.986,"5min":0.986,"15min":0.986},"max":{"1min":2.702,"5min":2.702,"15min":2.702},"last":1.606},{"interface":"front","average":{"1min":1.638,"5min":1.821,"15min":1.851},"min":{"1min":0.939,"5min":0.939,"15min":0.939},"max":{"1min":2.224,"5min":2.386,"15min":2.386},"last":1.926}]},{"osd":9,"last update":"Tue Dec 24 22:06:16 2019","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.779,"15min":1.789},"min":{"1min":1.111,"5min":1.111,"15min":1.111},"max":{"1min":2.549,"5min":2.549,"15min":2.549},"last":1.675},{"interface":"front","average":{"1min":1.708,"5min":1.823,"15min":1.842},"min":{"1min":1.159,"5min":1.159,"15min":1.159},"max":{"1min":2.493,"5min":2.493,"15min":2.493},"last":1.991}]},{"osd":10,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.735,"5min":1.735,"15min":1.735},"min":{"1min":1.214,"5min":1.214,"15min":1.214},"max":{"1min":2.640,"5min":2.640,"15min":2.640},"last":1.756},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":1.126,"5min":1.126,"15min":1.126},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.844}]}]}]}} 2019-12-24T22:06:21.771 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2019-12-24T22:06:21.771 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2019-12-24T22:06:21.771 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2019-12-24T22:06:21.772 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph health --format=json 2019-12-24T22:06:24.001 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:06:24.544 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2019-12-24T22:06:24.545 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2019-12-24T22:06:24.545 INFO:tasks.cephadm:Setup complete, yielding 2019-12-24T22:06:24.545 INFO:teuthology.run_tasks:Running task thrashosds... 2019-12-24T22:06:24.561 INFO:tasks.thrashosds:config is {'dump_ops_enable': 'true', 'timeout': 1200, 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'optrack_toggle_delay': 2.0, 'chance_pgpnum_fix': 1, 'aggressive_pg_num_changes': False, 'chance_pgnum_grow': 1, 'sighup_delay': 0.1} 2019-12-24T22:06:24.561 INFO:tasks.thrashosds:overrides is {'ceph': {'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MON_DOWN\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow requests'], 'conf': {'client.2': {'debug objecter': 20, 'debug ms': 1, 'debug rados': 20}, 'global': {'osd_pool_default_min_size': 2, 'ms tcp read timeout': 5, 'osd_pool_default_size': 3, 'ms inject socket failures': 2500, 'mon client directed command retry': 5}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'debug ms': 1, 'mon osdmap full prune min': 15, 'mon osdmap full prune interval': 2, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10}, 'osd': {'osd op queue cut off': 'debug_random', 'debug ms': 1, 'debug journal': 20, 'osd scrub max interval': 120, 'osd max backfills': 3, 'debug osd': 25, 'osd snap trim sleep': 2, 'osd debug reject backfill probability': 0.3, 'osd debug verify missing on start': True, 'osd op queue': 'debug_random', 'osd debug verify cached snaps': True, 'osd scrub min interval': 60, 'debug filestore': 20, 'osd shutdown pgref assert': True}}, 'sha1': '7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': '7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01'}}, 'admin_socket': {'branch': 'wip-sage-testing-2019-12-23-1810'}, 'thrashosds': {'min_in': 4}, 'workunit': {'sha1': 'ae3ed51e14ccef082d0470205ec570125f0f3d4f', 'branch': 'wip-cephadm-cot'}} 2019-12-24T22:06:24.561 INFO:tasks.thrashosds:config is {'dump_ops_enable': 'true', 'timeout': 1200, 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'optrack_toggle_delay': 2.0, 'chance_pgpnum_fix': 1, 'aggressive_pg_num_changes': False, 'min_in': 4, 'chance_pgnum_grow': 1, 'sighup_delay': 0.1} 2019-12-24T22:06:24.561 INFO:tasks.thrashosds:Beginning thrashosds... 2019-12-24T22:06:24.564 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2019-12-24T22:06:24.564 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph pg dump --format=json 2019-12-24T22:06:26.888 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:06:26.888 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2019-12-24T22:06:27.489 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2019-12-24T22:06:26.083585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":12,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1124941824,"kb_used":12590832,"kb_used_data":7824,"kb_used_omap":0,"kb_used_meta":12582912,"kb_avail":1112350992,"statfs":{"total":1151940427776,"available":1139047415808,"internally_reserved":12884901888,"allocated":8011776,"data_stored":3809544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12884901888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":11,"up_from":63,"seq":270582939670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.035,"5min":1.035,"15min":1.035},"min":{"1min":0.457,"5min":0.457,"15min":0.457},"max":{"1min":1.790,"5min":1.790,"15min":1.790},"last":0.759},{"interface":"front","average":{"1min":1.035,"5min":1.035,"15min":1.035},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.908,"5min":1.908,"15min":1.908},"last":1.233}]},{"osd":1,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.043,"5min":1.043,"15min":1.043},"min":{"1min":0.559,"5min":0.559,"15min":0.559},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":1.162},{"interface":"front","average":{"1min":0.920,"5min":0.920,"15min":0.920},"min":{"1min":0.591,"5min":0.591,"15min":0.591},"max":{"1min":1.539,"5min":1.539,"15min":1.539},"last":1.052}]},{"osd":2,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.946,"5min":0.946,"15min":0.946},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.059,"5min":2.059,"15min":2.059},"last":1.009},{"interface":"front","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.673,"5min":0.673,"15min":0.673},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.354}]},{"osd":3,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.140,"5min":1.140,"15min":1.140},"min":{"1min":0.518,"5min":0.518,"15min":0.518},"max":{"1min":2.138,"5min":2.138,"15min":2.138},"last":1.284},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.659,"5min":0.659,"15min":0.659},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.720}]},{"osd":4,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.965,"5min":0.965,"15min":0.965},"max":{"1min":2.013,"5min":2.013,"15min":2.013},"last":0.853},{"interface":"front","average":{"1min":1.260,"5min":1.260,"15min":1.260},"min":{"1min":0.786,"5min":0.786,"15min":0.786},"max":{"1min":2.197,"5min":2.197,"15min":2.197},"last":0.809}]},{"osd":5,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.533,"5min":1.533,"15min":1.533},"min":{"1min":1.098,"5min":1.098,"15min":1.098},"max":{"1min":2.455,"5min":2.455,"15min":2.455},"last":1.420},{"interface":"front","average":{"1min":1.350,"5min":1.350,"15min":1.350},"min":{"1min":0.674,"5min":0.674,"15min":0.674},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.962}]},{"osd":6,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.362,"5min":1.362,"15min":1.362},"min":{"1min":0.883,"5min":0.883,"15min":0.883},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.317},{"interface":"front","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":1.289,"5min":1.289,"15min":1.289},"max":{"1min":2.778,"5min":2.778,"15min":2.778},"last":1.556}]},{"osd":7,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":1.112,"5min":1.112,"15min":1.112},"max":{"1min":2.337,"5min":2.337,"15min":2.337},"last":1.388},{"interface":"front","average":{"1min":1.640,"5min":1.640,"15min":1.640},"min":{"1min":1.169,"5min":1.169,"15min":1.169},"max":{"1min":2.897,"5min":2.897,"15min":2.897},"last":1.486}]},{"osd":8,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.432,"5min":1.432,"15min":1.432},"min":{"1min":0.849,"5min":0.849,"15min":0.849},"max":{"1min":1.834,"5min":1.834,"15min":1.834},"last":1.096},{"interface":"front","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":1.076,"5min":1.076,"15min":1.076},"max":{"1min":3.173,"5min":3.173,"15min":3.173},"last":1.448}]},{"osd":10,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.461,"5min":1.461,"15min":1.461},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":1.808,"5min":1.808,"15min":1.808},"last":1.208},{"interface":"front","average":{"1min":1.701,"5min":1.701,"15min":1.701},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.985,"5min":2.985,"15min":2.985},"last":1.521}]}]},{"osd":10,"up_from":58,"seq":249108103194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.804}]},{"osd":1,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":0.965,"5min":0.965,"15min":0.965},"min":{"1min":0.573,"5min":0.573,"15min":0.573},"max":{"1min":1.612,"5min":1.612,"15min":1.612},"last":1.361},{"interface":"front","average":{"1min":0.963,"5min":0.963,"15min":0.963},"min":{"1min":0.612,"5min":0.612,"15min":0.612},"max":{"1min":1.410,"5min":1.410,"15min":1.410},"last":1.151}]},{"osd":2,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":0.985,"5min":0.985,"15min":0.985},"min":{"1min":0.575,"5min":0.575,"15min":0.575},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.678},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.645,"5min":0.645,"15min":0.645},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.736}]},{"osd":3,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.358,"5min":1.358,"15min":1.358},"min":{"1min":0.579,"5min":0.579,"15min":0.579},"max":{"1min":8.538,"5min":8.538,"15min":8.538},"last":1.237},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.655,"5min":0.655,"15min":0.655},"max":{"1min":8.477,"5min":8.477,"15min":8.477},"last":0.881}]},{"osd":4,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.328,"5min":1.328,"15min":1.328},"min":{"1min":0.802,"5min":0.802,"15min":0.802},"max":{"1min":1.815,"5min":1.815,"15min":1.815},"last":1.446},{"interface":"front","average":{"1min":1.350,"5min":1.350,"15min":1.350},"min":{"1min":0.882,"5min":0.882,"15min":0.882},"max":{"1min":1.880,"5min":1.880,"15min":1.880},"last":1.474}]},{"osd":5,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.382,"5min":1.382,"15min":1.382},"min":{"1min":0.848,"5min":0.848,"15min":0.848},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":1.518},{"interface":"front","average":{"1min":1.396,"5min":1.396,"15min":1.396},"min":{"1min":0.980,"5min":0.980,"15min":0.980},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.293}]},{"osd":6,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.750,"5min":0.750,"15min":0.750},"max":{"1min":2.063,"5min":2.063,"15min":2.063},"last":1.022},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.838,"5min":0.838,"15min":0.838},"max":{"1min":2.025,"5min":2.025,"15min":2.025},"last":0.979}]},{"osd":7,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.279,"5min":2.279,"15min":2.279},"last":1.126},{"interface":"front","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":1.224,"5min":1.224,"15min":1.224},"max":{"1min":2.125,"5min":2.125,"15min":2.125},"last":1.320}]},{"osd":8,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.558,"5min":1.558,"15min":1.558},"min":{"1min":0.888,"5min":0.888,"15min":0.888},"max":{"1min":2.178,"5min":2.178,"15min":2.178},"last":0.788},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.757,"5min":0.757,"15min":0.757},"max":{"1min":2.007,"5min":2.007,"15min":2.007},"last":1.083}]},{"osd":9,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.578,"5min":1.578,"15min":1.578},"min":{"1min":0.616,"5min":0.616,"15min":0.616},"max":{"1min":2.446,"5min":2.446,"15min":2.446},"last":1.181},{"interface":"front","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.566,"5min":0.566,"15min":0.566},"max":{"1min":2.193,"5min":2.193,"15min":2.193},"last":0.944}]},{"osd":11,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.738,"5min":1.738,"15min":1.738},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.405},{"interface":"front","average":{"1min":1.588,"5min":1.588,"15min":1.588},"min":{"1min":1.143,"5min":1.143,"15min":1.143},"max":{"1min":2.123,"5min":2.123,"15min":2.123},"last":1.608}]}]},{"osd":9,"up_from":53,"seq":227633266717,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":0.887,"5min":0.915,"15min":0.920},"min":{"1min":0.585,"5min":0.475,"15min":0.475},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":1.117},{"interface":"front","average":{"1min":0.965,"5min":0.901,"15min":0.890},"min":{"1min":0.574,"5min":0.484,"15min":0.484},"max":{"1min":2.330,"5min":2.330,"15min":2.330},"last":1.011}]},{"osd":1,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":0.856,"5min":0.841,"15min":0.839},"min":{"1min":0.562,"5min":0.562,"15min":0.562},"max":{"1min":1.482,"5min":1.660,"15min":1.660},"last":0.748},{"interface":"front","average":{"1min":1.124,"5min":1.098,"15min":1.094},"min":{"1min":0.785,"5min":0.674,"15min":0.674},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.871}]},{"osd":2,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.054,"15min":1.051},"min":{"1min":0.689,"5min":0.536,"15min":0.536},"max":{"1min":1.731,"5min":1.731,"15min":1.731},"last":1.266},{"interface":"front","average":{"1min":0.962,"5min":1.055,"15min":1.071},"min":{"1min":0.540,"5min":0.540,"15min":0.540},"max":{"1min":2.064,"5min":2.064,"15min":2.064},"last":0.597}]},{"osd":3,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.287,"5min":1.259,"15min":1.254},"min":{"1min":0.608,"5min":0.608,"15min":0.608},"max":{"1min":1.803,"5min":1.803,"15min":1.803},"last":1.575},{"interface":"front","average":{"1min":1.219,"5min":1.133,"15min":1.119},"min":{"1min":0.648,"5min":0.627,"15min":0.627},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":1.303}]},{"osd":4,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.142,"5min":0.965,"15min":0.935},"min":{"1min":0.742,"5min":0.484,"15min":0.484},"max":{"1min":1.842,"5min":1.842,"15min":1.842},"last":1.053},{"interface":"front","average":{"1min":1.480,"5min":1.348,"15min":1.326},"min":{"1min":0.872,"5min":0.803,"15min":0.803},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.338}]},{"osd":5,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.283,"5min":1.271,"15min":1.269},"min":{"1min":0.921,"5min":0.781,"15min":0.781},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":0.795},{"interface":"front","average":{"1min":1.228,"5min":1.127,"15min":1.110},"min":{"1min":1.003,"5min":0.843,"15min":0.843},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":1.168}]},{"osd":6,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.457,"5min":1.323,"15min":1.301},"min":{"1min":1.099,"5min":0.907,"15min":0.907},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.431},{"interface":"front","average":{"1min":1.376,"5min":1.238,"15min":1.215},"min":{"1min":1.041,"5min":0.751,"15min":0.751},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.371}]},{"osd":7,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.448,"15min":1.424},"min":{"1min":1.013,"5min":0.891,"15min":0.891},"max":{"1min":2.047,"5min":2.047,"15min":2.047},"last":1.467},{"interface":"front","average":{"1min":1.531,"5min":1.455,"15min":1.442},"min":{"1min":1.145,"5min":0.723,"15min":0.723},"max":{"1min":2.134,"5min":2.134,"15min":2.134},"last":1.239}]},{"osd":8,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.392,"15min":1.368},"min":{"1min":1.038,"5min":0.555,"15min":0.555},"max":{"1min":2.212,"5min":2.212,"15min":2.212},"last":0.701},{"interface":"front","average":{"1min":1.616,"5min":1.417,"15min":1.384},"min":{"1min":1.192,"5min":0.605,"15min":0.605},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":1.081}]},{"osd":10,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.315,"5min":1.315,"15min":1.315},"min":{"1min":0.865,"5min":0.865,"15min":0.865},"max":{"1min":1.713,"5min":1.713,"15min":1.713},"last":0.969},{"interface":"front","average":{"1min":1.662,"5min":1.662,"15min":1.662},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":2.128,"5min":2.128,"15min":2.128},"last":1.522}]}]},{"osd":8,"up_from":48,"seq":206158430242,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.887,"5min":0.873,"15min":0.871},"min":{"1min":0.512,"5min":0.512,"15min":0.512},"max":{"1min":1.441,"5min":2.639,"15min":2.639},"last":0.615},{"interface":"front","average":{"1min":0.795,"5min":0.792,"15min":0.792},"min":{"1min":0.480,"5min":0.480,"15min":0.480},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":1.103}]},{"osd":1,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.983,"5min":1.044,"15min":1.054},"min":{"1min":0.585,"5min":0.585,"15min":0.585},"max":{"1min":1.346,"5min":1.864,"15min":1.864},"last":1.003},{"interface":"front","average":{"1min":1.007,"5min":1.123,"15min":1.142},"min":{"1min":0.470,"5min":0.470,"15min":0.470},"max":{"1min":1.620,"5min":2.751,"15min":2.751},"last":0.930}]},{"osd":2,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.897,"5min":0.953,"15min":0.962},"min":{"1min":0.579,"5min":0.579,"15min":0.579},"max":{"1min":1.315,"5min":1.581,"15min":1.581},"last":0.829},{"interface":"front","average":{"1min":1.043,"5min":1.039,"15min":1.039},"min":{"1min":0.550,"5min":0.550,"15min":0.550},"max":{"1min":1.542,"5min":1.813,"15min":1.813},"last":0.738}]},{"osd":3,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.961,"5min":0.969,"15min":0.971},"min":{"1min":0.567,"5min":0.563,"15min":0.563},"max":{"1min":1.448,"5min":1.669,"15min":1.669},"last":0.666},{"interface":"front","average":{"1min":1.168,"5min":1.140,"15min":1.135},"min":{"1min":0.631,"5min":0.631,"15min":0.631},"max":{"1min":1.558,"5min":2.925,"15min":2.925},"last":1.060}]},{"osd":4,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.194,"15min":1.188},"min":{"1min":0.866,"5min":0.659,"15min":0.659},"max":{"1min":1.567,"5min":2.839,"15min":2.839},"last":1.223},{"interface":"front","average":{"1min":0.991,"5min":1.067,"15min":1.079},"min":{"1min":0.748,"5min":0.726,"15min":0.726},"max":{"1min":1.284,"5min":1.617,"15min":1.617},"last":1.249}]},{"osd":5,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.357,"15min":1.355},"min":{"1min":1.056,"5min":0.958,"15min":0.958},"max":{"1min":1.876,"5min":1.916,"15min":1.916},"last":1.380},{"interface":"front","average":{"1min":1.576,"5min":1.510,"15min":1.499},"min":{"1min":1.034,"5min":1.008,"15min":1.008},"max":{"1min":1.863,"5min":3.434,"15min":3.434},"last":1.442}]},{"osd":6,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.200,"15min":1.194},"min":{"1min":0.769,"5min":0.769,"15min":0.769},"max":{"1min":1.723,"5min":1.723,"15min":1.723},"last":1.704},{"interface":"front","average":{"1min":1.435,"5min":1.390,"15min":1.382},"min":{"1min":1.018,"5min":0.862,"15min":0.862},"max":{"1min":1.880,"5min":2.141,"15min":2.141},"last":1.760}]},{"osd":7,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.465,"5min":1.493,"15min":1.498},"min":{"1min":0.972,"5min":0.897,"15min":0.897},"max":{"1min":1.770,"5min":3.335,"15min":3.335},"last":1.456},{"interface":"front","average":{"1min":1.311,"5min":1.335,"15min":1.339},"min":{"1min":0.897,"5min":0.897,"15min":0.897},"max":{"1min":1.509,"5min":1.845,"15min":1.845},"last":1.631}]},{"osd":9,"last update":"Tue Dec 24 22:06:17 2019","interfaces":[{"interface":"back","average":{"1min":1.311,"5min":1.329,"15min":1.332},"min":{"1min":0.877,"5min":0.523,"15min":0.523},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.327},{"interface":"front","average":{"1min":1.332,"5min":1.289,"15min":1.282},"min":{"1min":0.797,"5min":0.693,"15min":0.693},"max":{"1min":1.729,"5min":1.747,"15min":1.747},"last":1.172}]},{"osd":10,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.390,"5min":1.390,"15min":1.390},"min":{"1min":0.854,"5min":0.854,"15min":0.854},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.583},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.705,"5min":0.705,"15min":0.705},"max":{"1min":2.257,"5min":2.257,"15min":2.257},"last":1.620}]}]},{"osd":7,"up_from":43,"seq":184683593766,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.142,"15min":1.152},"min":{"1min":0.701,"5min":0.701,"15min":0.701},"max":{"1min":1.766,"5min":2.044,"15min":2.044},"last":0.957},{"interface":"front","average":{"1min":1.085,"5min":1.129,"15min":1.136},"min":{"1min":0.652,"5min":0.630,"15min":0.630},"max":{"1min":1.942,"5min":1.954,"15min":1.954},"last":0.584}]},{"osd":1,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.186,"5min":1.015,"15min":0.987},"min":{"1min":0.686,"5min":0.567,"15min":0.567},"max":{"1min":1.688,"5min":1.688,"15min":1.688},"last":1.254},{"interface":"front","average":{"1min":1.193,"5min":1.077,"15min":1.057},"min":{"1min":0.612,"5min":0.612,"15min":0.612},"max":{"1min":1.945,"5min":1.945,"15min":1.945},"last":0.730}]},{"osd":2,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.253,"5min":1.104,"15min":1.079},"min":{"1min":0.829,"5min":0.646,"15min":0.646},"max":{"1min":1.880,"5min":2.181,"15min":2.181},"last":1.124},{"interface":"front","average":{"1min":1.137,"5min":1.133,"15min":1.132},"min":{"1min":0.780,"5min":0.592,"15min":0.592},"max":{"1min":1.813,"5min":1.813,"15min":1.813},"last":1.075}]},{"osd":3,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.185,"5min":1.135,"15min":1.127},"min":{"1min":0.684,"5min":0.636,"15min":0.636},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.662},{"interface":"front","average":{"1min":1.102,"5min":1.113,"15min":1.115},"min":{"1min":0.794,"5min":0.772,"15min":0.772},"max":{"1min":1.444,"5min":1.759,"15min":1.759},"last":0.850}]},{"osd":4,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":0.917,"5min":1.057,"15min":1.081},"min":{"1min":0.511,"5min":0.494,"15min":0.494},"max":{"1min":1.403,"5min":2.270,"15min":2.270},"last":1.036},{"interface":"front","average":{"1min":1.004,"5min":1.118,"15min":1.137},"min":{"1min":0.703,"5min":0.703,"15min":0.703},"max":{"1min":1.603,"5min":1.815,"15min":1.815},"last":1.772}]},{"osd":5,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.357,"15min":1.363},"min":{"1min":0.723,"5min":0.723,"15min":0.723},"max":{"1min":1.878,"5min":2.144,"15min":2.144},"last":1.324},{"interface":"front","average":{"1min":1.459,"5min":1.373,"15min":1.359},"min":{"1min":0.824,"5min":0.638,"15min":0.638},"max":{"1min":2.150,"5min":2.412,"15min":2.412},"last":1.175}]},{"osd":6,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.497,"15min":1.515},"min":{"1min":0.869,"5min":0.869,"15min":0.869},"max":{"1min":2.447,"5min":2.668,"15min":2.668},"last":1.465},{"interface":"front","average":{"1min":1.479,"5min":1.437,"15min":1.430},"min":{"1min":0.851,"5min":0.851,"15min":0.851},"max":{"1min":2.011,"5min":2.039,"15min":2.039},"last":1.658}]},{"osd":8,"last update":"Tue Dec 24 22:06:03 2019","interfaces":[{"interface":"back","average":{"1min":1.563,"5min":1.631,"15min":1.643},"min":{"1min":0.825,"5min":0.825,"15min":0.825},"max":{"1min":2.549,"5min":2.549,"15min":2.549},"last":2.019},{"interface":"front","average":{"1min":1.528,"5min":1.608,"15min":1.621},"min":{"1min":0.965,"5min":0.965,"15min":0.965},"max":{"1min":2.215,"5min":2.442,"15min":2.442},"last":1.291}]},{"osd":9,"last update":"Tue Dec 24 22:06:16 2019","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.678,"15min":1.693},"min":{"1min":1.158,"5min":1.136,"15min":1.136},"max":{"1min":2.033,"5min":2.558,"15min":2.558},"last":1.862},{"interface":"front","average":{"1min":1.628,"5min":1.756,"15min":1.777},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":2.183,"5min":2.398,"15min":2.398},"last":1.504}]},{"osd":10,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.727,"5min":1.727,"15min":1.727},"min":{"1min":1.379,"5min":1.379,"15min":1.379},"max":{"1min":2.372,"5min":2.372,"15min":2.372},"last":2.103},{"interface":"front","average":{"1min":1.739,"5min":1.739,"15min":1.739},"min":{"1min":1.304,"5min":1.304,"15min":1.304},"max":{"1min":2.289,"5min":2.289,"15min":2.289},"last":1.580}]}]},{"osd":6,"up_from":38,"seq":163208757290,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:06:23 2019","interfaces":[{"interface":"back","average":{"1min":0.967,"5min":0.986,"15min":0.997},"min":{"1min":0.591,"5min":0.462,"15min":0.462},"max":{"1min":1.534,"5min":1.548,"15min":1.548},"last":0.964},{"interface":"front","average":{"1min":1.080,"5min":0.997,"15min":0.992},"min":{"1min":0.574,"5min":0.548,"15min":0.548},"max":{"1min":1.765,"5min":1.765,"15min":1.765},"last":0.813}]},{"osd":1,"last update":"Tue Dec 24 22:06:23 2019","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.029,"15min":0.959},"min":{"1min":0.621,"5min":0.574,"15min":0.574},"max":{"1min":1.809,"5min":7.126,"15min":7.126},"last":1.071},{"interface":"front","average":{"1min":1.107,"5min":1.092,"15min":1.016},"min":{"1min":0.851,"5min":0.677,"15min":0.677},"max":{"1min":1.488,"5min":7.085,"15min":7.085},"last":0.908}]},{"osd":2,"last update":"Tue Dec 24 22:06:23 2019","interfaces":[{"interface":"back","average":{"1min":1.203,"5min":1.133,"15min":1.117},"min":{"1min":0.836,"5min":0.688,"15min":0.688},"max":{"1min":2.060,"5min":2.060,"15min":2.060},"last":1.207},{"interface":"front","average":{"1min":1.225,"5min":1.179,"15min":1.182},"min":{"1min":0.568,"5min":0.568,"15min":0.568},"max":{"1min":1.850,"5min":2.626,"15min":2.626},"last":0.591}]},{"osd":3,"last update":"Tue Dec 24 22:06:23 2019","interfaces":[{"interface":"back","average":{"1min":1.128,"5min":1.073,"15min":1.055},"min":{"1min":0.591,"5min":0.591,"15min":0.591},"max":{"1min":2.633,"5min":2.633,"15min":2.633},"last":0.679},{"interface":"front","average":{"1min":0.999,"5min":1.100,"15min":1.153},"min":{"1min":0.653,"5min":0.591,"15min":0.591},"max":{"1min":1.692,"5min":1.692,"15min":1.692},"last":1.692}]},{"osd":4,"last update":"Tue Dec 24 22:06:23 2019","interfaces":[{"interface":"back","average":{"1min":1.126,"5min":1.124,"15min":1.123},"min":{"1min":0.641,"5min":0.485,"15min":0.485},"max":{"1min":1.731,"5min":1.731,"15min":1.731},"last":0.748},{"interface":"front","average":{"1min":1.266,"5min":1.218,"15min":1.209},"min":{"1min":0.771,"5min":0.700,"15min":0.700},"max":{"1min":1.578,"5min":2.005,"15min":2.005},"last":1.511}]},{"osd":5,"last update":"Tue Dec 24 22:06:23 2019","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.278,"15min":1.306},"min":{"1min":0.633,"5min":0.620,"15min":0.620},"max":{"1min":1.743,"5min":2.033,"15min":2.033},"last":0.870},{"interface":"front","average":{"1min":1.348,"5min":1.348,"15min":1.354},"min":{"1min":0.945,"5min":0.614,"15min":0.614},"max":{"1min":1.664,"5min":1.861,"15min":1.861},"last":1.263}]},{"osd":7,"last update":"Tue Dec 24 22:05:38 2019","interfaces":[{"interface":"back","average":{"1min":1.186,"5min":1.318,"15min":1.340},"min":{"1min":0.779,"5min":0.681,"15min":0.681},"max":{"1min":1.512,"5min":1.948,"15min":1.948},"last":1.332},{"interface":"front","average":{"1min":1.405,"5min":1.401,"15min":1.400},"min":{"1min":1.013,"5min":0.708,"15min":0.708},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":1.399}]},{"osd":8,"last update":"Tue Dec 24 22:05:58 2019","interfaces":[{"interface":"back","average":{"1min":1.615,"5min":1.699,"15min":1.713},"min":{"1min":1.200,"5min":1.200,"15min":1.200},"max":{"1min":2.000,"5min":2.450,"15min":2.450},"last":1.444},{"interface":"front","average":{"1min":1.517,"5min":1.655,"15min":1.678},"min":{"1min":1.236,"5min":1.236,"15min":1.236},"max":{"1min":1.937,"5min":2.224,"15min":2.224},"last":2.171}]},{"osd":9,"last update":"Tue Dec 24 22:06:18 2019","interfaces":[{"interface":"back","average":{"1min":1.757,"5min":1.795,"15min":1.801},"min":{"1min":1.480,"5min":1.426,"15min":1.426},"max":{"1min":2.197,"5min":2.282,"15min":2.282},"last":1.795},{"interface":"front","average":{"1min":1.654,"5min":1.683,"15min":1.688},"min":{"1min":1.339,"5min":1.115,"15min":1.115},"max":{"1min":2.808,"5min":2.808,"15min":2.808},"last":1.590}]},{"osd":10,"last update":"Tue Dec 24 22:05:38 2019","interfaces":[{"interface":"back","average":{"1min":1.814,"5min":1.814,"15min":1.814},"min":{"1min":1.465,"5min":1.465,"15min":1.465},"max":{"1min":2.603,"5min":2.603,"15min":2.603},"last":1.756},{"interface":"front","average":{"1min":1.699,"5min":1.699,"15min":1.699},"min":{"1min":1.314,"5min":1.314,"15min":1.314},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.622}]}]},{"osd":1,"up_from":12,"seq":51539607614,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:37 2019","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.748,"15min":0.670},"min":{"1min":0.611,"5min":0.406,"15min":0.406},"max":{"1min":1.267,"5min":1.491,"15min":1.491},"last":0.397},{"interface":"front","average":{"1min":0.839,"5min":0.777,"15min":0.745},"min":{"1min":0.539,"5min":0.285,"15min":0.285},"max":{"1min":1.340,"5min":1.701,"15min":1.701},"last":0.624}]},{"osd":2,"last update":"Tue Dec 24 22:06:00 2019","interfaces":[{"interface":"back","average":{"1min":0.812,"5min":0.830,"15min":0.787},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.626,"5min":1.626,"15min":1.626},"last":0.810},{"interface":"front","average":{"1min":0.926,"5min":0.789,"15min":0.772},"min":{"1min":0.538,"5min":0.538,"15min":0.538},"max":{"1min":2.075,"5min":2.075,"15min":2.075},"last":0.761}]},{"osd":3,"last update":"Tue Dec 24 22:06:14 2019","interfaces":[{"interface":"back","average":{"1min":0.919,"5min":0.902,"15min":0.819},"min":{"1min":0.521,"5min":0.515,"15min":0.515},"max":{"1min":1.728,"5min":1.866,"15min":1.866},"last":0.882},{"interface":"front","average":{"1min":1.112,"5min":1.042,"15min":0.983},"min":{"1min":0.508,"5min":0.508,"15min":0.508},"max":{"1min":2.152,"5min":2.152,"15min":2.152},"last":0.928}]},{"osd":4,"last update":"Tue Dec 24 22:05:37 2019","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.981,"15min":0.951},"min":{"1min":0.624,"5min":0.585,"15min":0.585},"max":{"1min":1.740,"5min":1.740,"15min":1.740},"last":1.460},{"interface":"front","average":{"1min":1.252,"5min":1.098,"15min":1.051},"min":{"1min":0.831,"5min":0.701,"15min":0.701},"max":{"1min":1.747,"5min":1.843,"15min":1.843},"last":1.418}]},{"osd":5,"last update":"Tue Dec 24 22:06:00 2019","interfaces":[{"interface":"back","average":{"1min":1.289,"5min":1.283,"15min":1.309},"min":{"1min":0.829,"5min":0.733,"15min":0.733},"max":{"1min":2.551,"5min":2.551,"15min":2.551},"last":1.331},{"interface":"front","average":{"1min":1.471,"5min":1.153,"15min":1.005},"min":{"1min":0.921,"5min":0.619,"15min":0.619},"max":{"1min":2.243,"5min":2.243,"15min":2.243},"last":1.287}]},{"osd":6,"last update":"Tue Dec 24 22:06:18 2019","interfaces":[{"interface":"back","average":{"1min":1.313,"5min":1.252,"15min":1.202},"min":{"1min":0.730,"5min":0.618,"15min":0.618},"max":{"1min":2.094,"5min":2.094,"15min":2.094},"last":1.175},{"interface":"front","average":{"1min":1.445,"5min":1.488,"15min":1.482},"min":{"1min":0.907,"5min":0.802,"15min":0.802},"max":{"1min":2.075,"5min":2.358,"15min":2.358},"last":1.101}]},{"osd":7,"last update":"Tue Dec 24 22:05:37 2019","interfaces":[{"interface":"back","average":{"1min":1.485,"5min":1.359,"15min":1.338},"min":{"1min":0.972,"5min":0.970,"15min":0.970},"max":{"1min":2.212,"5min":2.212,"15min":2.212},"last":1.027},{"interface":"front","average":{"1min":1.643,"5min":1.569,"15min":1.557},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":2.475,"5min":2.475,"15min":2.475},"last":1.517}]},{"osd":8,"last update":"Tue Dec 24 22:06:00 2019","interfaces":[{"interface":"back","average":{"1min":1.582,"5min":1.633,"15min":1.641},"min":{"1min":1.093,"5min":1.093,"15min":1.093},"max":{"1min":2.716,"5min":2.716,"15min":2.716},"last":1.261},{"interface":"front","average":{"1min":1.528,"5min":1.660,"15min":1.682},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":2.032,"5min":2.556,"15min":2.556},"last":1.356}]},{"osd":9,"last update":"Tue Dec 24 22:06:14 2019","interfaces":[{"interface":"back","average":{"1min":1.683,"5min":1.508,"15min":1.479},"min":{"1min":0.985,"5min":0.985,"15min":0.985},"max":{"1min":2.631,"5min":2.631,"15min":2.631},"last":1.077},{"interface":"front","average":{"1min":1.650,"5min":1.704,"15min":1.713},"min":{"1min":1.083,"5min":1.083,"15min":1.083},"max":{"1min":2.319,"5min":2.621,"15min":2.621},"last":1.580}]},{"osd":10,"last update":"Tue Dec 24 22:05:37 2019","interfaces":[{"interface":"back","average":{"1min":1.500,"5min":1.500,"15min":1.500},"min":{"1min":1.125,"5min":1.125,"15min":1.125},"max":{"1min":2.180,"5min":2.180,"15min":2.180},"last":1.150},{"interface":"front","average":{"1min":1.705,"5min":1.705,"15min":1.705},"min":{"1min":1.237,"5min":1.237,"15min":1.237},"max":{"1min":2.759,"5min":2.759,"15min":2.759},"last":1.708}]}]},{"osd":0,"up_from":7,"seq":30064771138,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 24 22:05:40 2019","interfaces":[{"interface":"back","average":{"1min":0.799,"5min":0.651,"15min":0.578},"min":{"1min":0.465,"5min":0.355,"15min":0.355},"max":{"1min":1.568,"5min":1.568,"15min":1.568},"last":0.573},{"interface":"front","average":{"1min":0.903,"5min":0.782,"15min":0.672},"min":{"1min":0.478,"5min":0.437,"15min":0.437},"max":{"1min":1.428,"5min":1.505,"15min":1.505},"last":0.628}]},{"osd":2,"last update":"Tue Dec 24 22:03:53 2019","interfaces":[{"interface":"back","average":{"1min":0.700,"5min":0.667,"15min":0.661},"min":{"1min":0.512,"5min":0.371,"15min":0.371},"max":{"1min":0.944,"5min":0.944,"15min":0.944},"last":0.545},{"interface":"front","average":{"1min":0.927,"5min":0.779,"15min":0.755},"min":{"1min":0.614,"5min":0.452,"15min":0.452},"max":{"1min":1.197,"5min":1.197,"15min":1.197},"last":0.705}]},{"osd":3,"last update":"Tue Dec 24 22:06:18 2019","interfaces":[{"interface":"back","average":{"1min":0.930,"5min":0.906,"15min":0.814},"min":{"1min":0.462,"5min":0.462,"15min":0.462},"max":{"1min":1.520,"5min":2.013,"15min":2.013},"last":0.802},{"interface":"front","average":{"1min":0.772,"5min":0.847,"15min":0.843},"min":{"1min":0.452,"5min":0.452,"15min":0.452},"max":{"1min":1.420,"5min":1.580,"15min":1.580},"last":0.732}]},{"osd":4,"last update":"Tue Dec 24 22:05:40 2019","interfaces":[{"interface":"back","average":{"1min":0.963,"5min":1.045,"15min":1.046},"min":{"1min":0.671,"5min":0.571,"15min":0.571},"max":{"1min":1.496,"5min":1.577,"15min":1.577},"last":0.961},{"interface":"front","average":{"1min":1.349,"5min":1.191,"15min":1.122},"min":{"1min":0.849,"5min":0.707,"15min":0.707},"max":{"1min":1.930,"5min":1.930,"15min":1.930},"last":1.042}]},{"osd":5,"last update":"Tue Dec 24 22:05:58 2019","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.121,"15min":1.128},"min":{"1min":0.549,"5min":0.549,"15min":0.549},"max":{"1min":1.702,"5min":2.085,"15min":2.085},"last":1.140},{"interface":"front","average":{"1min":1.378,"5min":1.264,"15min":1.192},"min":{"1min":0.910,"5min":0.887,"15min":0.887},"max":{"1min":2.325,"5min":2.325,"15min":2.325},"last":1.196}]},{"osd":6,"last update":"Tue Dec 24 22:06:18 2019","interfaces":[{"interface":"back","average":{"1min":1.051,"5min":1.191,"15min":1.199},"min":{"1min":0.817,"5min":0.709,"15min":0.709},"max":{"1min":1.371,"5min":2.019,"15min":2.019},"last":0.933},{"interface":"front","average":{"1min":1.253,"5min":1.319,"15min":1.329},"min":{"1min":0.828,"5min":0.828,"15min":0.828},"max":{"1min":1.796,"5min":1.970,"15min":1.970},"last":1.285}]},{"osd":7,"last update":"Tue Dec 24 22:05:40 2019","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.307,"15min":1.321},"min":{"1min":0.750,"5min":0.750,"15min":0.750},"max":{"1min":2.114,"5min":2.114,"15min":2.114},"last":1.012},{"interface":"front","average":{"1min":1.411,"5min":1.432,"15min":1.436},"min":{"1min":0.774,"5min":0.774,"15min":0.774},"max":{"1min":2.231,"5min":2.231,"15min":2.231},"last":1.334}]},{"osd":8,"last update":"Tue Dec 24 22:05:58 2019","interfaces":[{"interface":"back","average":{"1min":1.567,"5min":1.656,"15min":1.671},"min":{"1min":1.030,"5min":1.030,"15min":1.030},"max":{"1min":3.015,"5min":3.015,"15min":3.015},"last":2.110},{"interface":"front","average":{"1min":1.444,"5min":1.484,"15min":1.490},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.771,"5min":2.771,"15min":2.771},"last":1.148}]},{"osd":9,"last update":"Tue Dec 24 22:06:18 2019","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.605,"15min":1.610},"min":{"1min":0.983,"5min":0.712,"15min":0.712},"max":{"1min":2.274,"5min":2.652,"15min":2.652},"last":1.762},{"interface":"front","average":{"1min":1.379,"5min":1.449,"15min":1.461},"min":{"1min":1.079,"5min":0.792,"15min":0.792},"max":{"1min":2.022,"5min":2.175,"15min":2.175},"last":1.115}]},{"osd":10,"last update":"Tue Dec 24 22:05:35 2019","interfaces":[{"interface":"back","average":{"1min":1.490,"5min":1.490,"15min":1.490},"min":{"1min":0.835,"5min":0.835,"15min":0.835},"max":{"1min":2.424,"5min":2.424,"15min":2.424},"last":1.504},{"interface":"front","average":{"1min":1.739,"5min":1.739,"15min":1.739},"min":{"1min":1.192,"5min":1.192,"15min":1.192},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":1.895}]},{"osd":11,"last update":"Tue Dec 24 22:05:53 2019","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.986,"5min":0.986,"15min":0.986},"max":{"1min":2.571,"5min":2.571,"15min":2.571},"last":1.256},{"interface":"front","average":{"1min":1.864,"5min":1.864,"15min":1.864},"min":{"1min":1.023,"5min":1.023,"15min":1.023},"max":{"1min":9.942,"5min":9.942,"15min":9.942},"last":1.444}]}]},{"osd":2,"up_from":17,"seq":73014444089,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:06:02 2019","interfaces":[{"interface":"back","average":{"1min":0.851,"5min":0.717,"15min":0.651},"min":{"1min":0.440,"5min":0.409,"15min":0.409},"max":{"1min":1.481,"5min":1.481,"15min":1.481},"last":1.136},{"interface":"front","average":{"1min":0.813,"5min":0.771,"15min":0.735},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.665}]},{"osd":1,"last update":"Tue Dec 24 22:06:02 2019","interfaces":[{"interface":"back","average":{"1min":0.840,"5min":0.741,"15min":0.685},"min":{"1min":0.510,"5min":0.448,"15min":0.448},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.741},{"interface":"front","average":{"1min":1.022,"5min":0.923,"15min":0.836},"min":{"1min":0.431,"5min":0.431,"15min":0.431},"max":{"1min":1.705,"5min":1.705,"15min":1.705},"last":1.155}]},{"osd":3,"last update":"Tue Dec 24 22:06:19 2019","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.873,"15min":0.785},"min":{"1min":0.513,"5min":0.513,"15min":0.513},"max":{"1min":1.687,"5min":1.687,"15min":1.687},"last":0.513},{"interface":"front","average":{"1min":1.163,"5min":0.966,"15min":0.864},"min":{"1min":0.577,"5min":0.513,"15min":0.513},"max":{"1min":1.584,"5min":1.584,"15min":1.584},"last":0.823}]},{"osd":4,"last update":"Tue Dec 24 22:05:38 2019","interfaces":[{"interface":"back","average":{"1min":1.037,"5min":0.967,"15min":0.940},"min":{"1min":0.597,"5min":0.494,"15min":0.494},"max":{"1min":1.971,"5min":1.973,"15min":1.973},"last":1.253},{"interface":"front","average":{"1min":1.140,"5min":1.069,"15min":1.045},"min":{"1min":0.551,"5min":0.551,"15min":0.551},"max":{"1min":1.615,"5min":2.039,"15min":2.039},"last":0.766}]},{"osd":5,"last update":"Tue Dec 24 22:06:02 2019","interfaces":[{"interface":"back","average":{"1min":1.539,"5min":1.253,"15min":1.161},"min":{"1min":0.912,"5min":0.788,"15min":0.788},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.435},{"interface":"front","average":{"1min":1.372,"5min":1.122,"15min":1.063},"min":{"1min":0.665,"5min":0.548,"15min":0.548},"max":{"1min":2.299,"5min":2.299,"15min":2.299},"last":1.838}]},{"osd":6,"last update":"Tue Dec 24 22:06:19 2019","interfaces":[{"interface":"back","average":{"1min":1.483,"5min":1.284,"15min":1.186},"min":{"1min":0.608,"5min":0.608,"15min":0.608},"max":{"1min":2.691,"5min":2.691,"15min":2.691},"last":1.518},{"interface":"front","average":{"1min":1.214,"5min":1.349,"15min":1.394},"min":{"1min":0.705,"5min":0.680,"15min":0.680},"max":{"1min":1.775,"5min":2.777,"15min":2.777},"last":1.087}]},{"osd":7,"last update":"Tue Dec 24 22:05:36 2019","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.566,"15min":1.563},"min":{"1min":1.135,"5min":1.135,"15min":1.135},"max":{"1min":2.150,"5min":2.190,"15min":2.190},"last":1.314},{"interface":"front","average":{"1min":1.286,"5min":1.306,"15min":1.310},"min":{"1min":0.634,"5min":0.634,"15min":0.634},"max":{"1min":1.897,"5min":1.962,"15min":1.962},"last":1.214}]},{"osd":8,"last update":"Tue Dec 24 22:06:02 2019","interfaces":[{"interface":"back","average":{"1min":1.259,"5min":1.385,"15min":1.406},"min":{"1min":0.836,"5min":0.836,"15min":0.836},"max":{"1min":2.106,"5min":2.885,"15min":2.885},"last":1.577},{"interface":"front","average":{"1min":1.654,"5min":1.724,"15min":1.736},"min":{"1min":0.981,"5min":0.981,"15min":0.981},"max":{"1min":2.614,"5min":2.614,"15min":2.614},"last":1.950}]},{"osd":9,"last update":"Tue Dec 24 22:06:14 2019","interfaces":[{"interface":"back","average":{"1min":1.745,"5min":1.796,"15min":1.804},"min":{"1min":0.909,"5min":0.909,"15min":0.909},"max":{"1min":3.137,"5min":3.137,"15min":3.137},"last":2.037},{"interface":"front","average":{"1min":1.378,"5min":1.459,"15min":1.473},"min":{"1min":0.786,"5min":0.786,"15min":0.786},"max":{"1min":2.132,"5min":2.132,"15min":2.132},"last":1.046}]},{"osd":10,"last update":"Tue Dec 24 22:05:36 2019","interfaces":[{"interface":"back","average":{"1min":1.813,"5min":1.813,"15min":1.813},"min":{"1min":1.363,"5min":1.363,"15min":1.363},"max":{"1min":2.542,"5min":2.542,"15min":2.542},"last":2.138},{"interface":"front","average":{"1min":1.517,"5min":1.517,"15min":1.517},"min":{"1min":0.941,"5min":0.941,"15min":0.941},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.380}]}]},{"osd":3,"up_from":22,"seq":94489280565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:04:18 2019","interfaces":[{"interface":"back","average":{"1min":0.605,"5min":0.621,"15min":0.623},"min":{"1min":0.400,"5min":0.400,"15min":0.400},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":1.050},{"interface":"front","average":{"1min":0.747,"5min":0.759,"15min":0.761},"min":{"1min":0.459,"5min":0.449,"15min":0.449},"max":{"1min":1.095,"5min":1.130,"15min":1.130},"last":1.150}]},{"osd":1,"last update":"Tue Dec 24 22:05:20 2019","interfaces":[{"interface":"back","average":{"1min":0.927,"5min":0.737,"15min":0.706},"min":{"1min":0.495,"5min":0.465,"15min":0.465},"max":{"1min":3.316,"5min":3.316,"15min":3.316},"last":0.930},{"interface":"front","average":{"1min":1.148,"5min":0.923,"15min":0.889},"min":{"1min":0.525,"5min":0.525,"15min":0.525},"max":{"1min":3.686,"5min":3.686,"15min":3.686},"last":0.980}]},{"osd":2,"last update":"Tue Dec 24 22:05:20 2019","interfaces":[{"interface":"back","average":{"1min":0.923,"5min":0.860,"15min":0.852},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.696,"5min":2.696,"15min":2.696},"last":0.591},{"interface":"front","average":{"1min":0.933,"5min":0.850,"15min":0.845},"min":{"1min":0.393,"5min":0.393,"15min":0.393},"max":{"1min":1.525,"5min":1.525,"15min":1.525},"last":0.707}]},{"osd":4,"last update":"Tue Dec 24 22:05:40 2019","interfaces":[{"interface":"back","average":{"1min":1.200,"5min":1.142,"15min":1.140},"min":{"1min":0.667,"5min":0.667,"15min":0.667},"max":{"1min":1.620,"5min":1.825,"15min":1.825},"last":1.086},{"interface":"front","average":{"1min":1.040,"5min":1.064,"15min":1.051},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.673}]},{"osd":5,"last update":"Tue Dec 24 22:05:54 2019","interfaces":[{"interface":"back","average":{"1min":1.428,"5min":1.294,"15min":1.237},"min":{"1min":0.806,"5min":0.806,"15min":0.806},"max":{"1min":2.799,"5min":2.799,"15min":2.799},"last":0.844},{"interface":"front","average":{"1min":1.292,"5min":1.210,"15min":1.167},"min":{"1min":0.743,"5min":0.731,"15min":0.731},"max":{"1min":2.624,"5min":2.624,"15min":2.624},"last":1.044}]},{"osd":6,"last update":"Tue Dec 24 22:05:20 2019","interfaces":[{"interface":"back","average":{"1min":1.408,"5min":1.320,"15min":1.306},"min":{"1min":0.732,"5min":0.732,"15min":0.732},"max":{"1min":3.034,"5min":3.034,"15min":3.034},"last":0.770},{"interface":"front","average":{"1min":1.370,"5min":1.266,"15min":1.248},"min":{"1min":0.917,"5min":0.861,"15min":0.861},"max":{"1min":2.370,"5min":2.370,"15min":2.370},"last":1.207}]},{"osd":7,"last update":"Tue Dec 24 22:05:40 2019","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.269,"15min":1.273},"min":{"1min":0.662,"5min":0.662,"15min":0.662},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":1.143},{"interface":"front","average":{"1min":1.683,"5min":1.520,"15min":1.493},"min":{"1min":0.707,"5min":0.707,"15min":0.707},"max":{"1min":3.368,"5min":3.368,"15min":3.368},"last":1.326}]},{"osd":8,"last update":"Tue Dec 24 22:05:54 2019","interfaces":[{"interface":"back","average":{"1min":1.580,"5min":1.690,"15min":1.708},"min":{"1min":0.639,"5min":0.639,"15min":0.639},"max":{"1min":3.927,"5min":3.927,"15min":3.927},"last":1.516},{"interface":"front","average":{"1min":1.308,"5min":1.380,"15min":1.392},"min":{"1min":0.785,"5min":0.785,"15min":0.785},"max":{"1min":2.430,"5min":2.430,"15min":2.430},"last":1.367}]},{"osd":9,"last update":"Tue Dec 24 22:06:18 2019","interfaces":[{"interface":"back","average":{"1min":1.445,"5min":1.745,"15min":1.795},"min":{"1min":0.807,"5min":0.807,"15min":0.807},"max":{"1min":2.316,"5min":3.583,"15min":3.583},"last":1.404},{"interface":"front","average":{"1min":1.294,"5min":1.530,"15min":1.569},"min":{"1min":0.600,"5min":0.600,"15min":0.600},"max":{"1min":1.936,"5min":2.914,"15min":2.914},"last":1.182}]},{"osd":10,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.862,"5min":1.862,"15min":1.862},"min":{"1min":1.110,"5min":1.110,"15min":1.110},"max":{"1min":3.759,"5min":3.759,"15min":3.759},"last":1.572},{"interface":"front","average":{"1min":1.572,"5min":1.572,"15min":1.572},"min":{"1min":0.855,"5min":0.855,"15min":0.855},"max":{"1min":3.187,"5min":3.187,"15min":3.187},"last":1.304}]},{"osd":11,"last update":"Tue Dec 24 22:05:54 2019","interfaces":[{"interface":"back","average":{"1min":1.666,"5min":1.666,"15min":1.666},"min":{"1min":1.074,"5min":1.074,"15min":1.074},"max":{"1min":2.540,"5min":2.540,"15min":2.540},"last":1.470},{"interface":"front","average":{"1min":1.602,"5min":1.602,"15min":1.602},"min":{"1min":0.866,"5min":0.866,"15min":0.866},"max":{"1min":4.079,"5min":4.079,"15min":4.079},"last":1.269}]}]},{"osd":4,"up_from":27,"seq":115964117042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.156,"5min":0.984,"15min":0.924},"min":{"1min":0.641,"5min":0.441,"15min":0.441},"max":{"1min":2.050,"5min":2.050,"15min":2.050},"last":1.485},{"interface":"front","average":{"1min":0.933,"5min":1.052,"15min":1.080},"min":{"1min":0.637,"5min":0.584,"15min":0.584},"max":{"1min":1.418,"5min":1.653,"15min":1.653},"last":0.974}]},{"osd":1,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":0.902,"5min":0.909,"15min":0.903},"min":{"1min":0.602,"5min":0.592,"15min":0.592},"max":{"1min":1.795,"5min":1.795,"15min":1.795},"last":0.778},{"interface":"front","average":{"1min":1.297,"5min":1.185,"15min":1.149},"min":{"1min":0.574,"5min":0.574,"15min":0.574},"max":{"1min":1.946,"5min":2.229,"15min":2.229},"last":1.560}]},{"osd":2,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.098,"5min":0.998,"15min":0.952},"min":{"1min":0.676,"5min":0.550,"15min":0.550},"max":{"1min":1.862,"5min":2.144,"15min":2.144},"last":0.725},{"interface":"front","average":{"1min":1.096,"5min":1.048,"15min":1.050},"min":{"1min":0.748,"5min":0.564,"15min":0.564},"max":{"1min":1.481,"5min":1.821,"15min":1.821},"last":1.081}]},{"osd":3,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.358,"5min":1.124,"15min":1.068},"min":{"1min":0.714,"5min":0.637,"15min":0.637},"max":{"1min":1.799,"5min":1.799,"15min":1.799},"last":1.275},{"interface":"front","average":{"1min":1.313,"5min":1.042,"15min":0.969},"min":{"1min":0.975,"5min":0.585,"15min":0.585},"max":{"1min":1.655,"5min":1.852,"15min":1.852},"last":1.229}]},{"osd":5,"last update":"Tue Dec 24 22:06:09 2019","interfaces":[{"interface":"back","average":{"1min":1.251,"5min":1.132,"15min":1.055},"min":{"1min":0.645,"5min":0.510,"15min":0.510},"max":{"1min":1.773,"5min":2.081,"15min":2.081},"last":1.053},{"interface":"front","average":{"1min":1.165,"5min":1.131,"15min":1.125},"min":{"1min":0.644,"5min":0.557,"15min":0.557},"max":{"1min":1.601,"5min":2.611,"15min":2.611},"last":1.372}]},{"osd":6,"last update":"Tue Dec 24 22:06:20 2019","interfaces":[{"interface":"back","average":{"1min":1.443,"5min":1.333,"15min":1.281},"min":{"1min":0.785,"5min":0.576,"15min":0.576},"max":{"1min":1.967,"5min":2.028,"15min":2.028},"last":0.870},{"interface":"front","average":{"1min":0.996,"5min":1.116,"15min":1.133},"min":{"1min":0.610,"5min":0.610,"15min":0.610},"max":{"1min":1.486,"5min":2.187,"15min":2.187},"last":0.832}]},{"osd":7,"last update":"Tue Dec 24 22:05:38 2019","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.356,"15min":1.366},"min":{"1min":0.690,"5min":0.663,"15min":0.663},"max":{"1min":1.833,"5min":1.916,"15min":1.916},"last":1.626},{"interface":"front","average":{"1min":1.324,"5min":1.341,"15min":1.344},"min":{"1min":1.049,"5min":1.042,"15min":1.042},"max":{"1min":1.714,"5min":2.336,"15min":2.336},"last":1.532}]},{"osd":8,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.692,"5min":1.742,"15min":1.750},"min":{"1min":1.262,"5min":1.245,"15min":1.245},"max":{"1min":2.341,"5min":2.341,"15min":2.341},"last":1.673},{"interface":"front","average":{"1min":1.638,"5min":1.622,"15min":1.619},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":1.942}]},{"osd":9,"last update":"Tue Dec 24 22:06:13 2019","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.442,"15min":1.454},"min":{"1min":0.961,"5min":0.946,"15min":0.946},"max":{"1min":1.764,"5min":1.827,"15min":1.827},"last":1.439},{"interface":"front","average":{"1min":1.826,"5min":1.770,"15min":1.760},"min":{"1min":1.249,"5min":1.249,"15min":1.249},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":1.768}]},{"osd":10,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.563,"5min":1.563,"15min":1.563},"min":{"1min":1.089,"5min":1.089,"15min":1.089},"max":{"1min":1.902,"5min":1.902,"15min":1.902},"last":1.328},{"interface":"front","average":{"1min":1.893,"5min":1.893,"15min":1.893},"min":{"1min":1.447,"5min":1.447,"15min":1.447},"max":{"1min":2.356,"5min":2.356,"15min":2.356},"last":1.721}]}]},{"osd":5,"up_from":32,"seq":137438953518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:06:06 2019","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.888,"15min":0.830},"min":{"1min":0.630,"5min":0.466,"15min":0.466},"max":{"1min":2.180,"5min":2.180,"15min":2.180},"last":1.004},{"interface":"front","average":{"1min":1.187,"5min":1.031,"15min":0.982},"min":{"1min":0.796,"5min":0.613,"15min":0.613},"max":{"1min":2.320,"5min":2.320,"15min":2.320},"last":0.930}]},{"osd":1,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.057,"5min":1.069,"15min":1.075},"min":{"1min":0.554,"5min":0.554,"15min":0.554},"max":{"1min":1.864,"5min":1.864,"15min":1.864},"last":0.867},{"interface":"front","average":{"1min":1.133,"5min":1.140,"15min":1.136},"min":{"1min":0.601,"5min":0.601,"15min":0.601},"max":{"1min":3.438,"5min":3.438,"15min":3.438},"last":1.047}]},{"osd":2,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.158,"5min":1.122,"15min":1.120},"min":{"1min":0.527,"5min":0.527,"15min":0.527},"max":{"1min":2.248,"5min":2.248,"15min":2.248},"last":1.153},{"interface":"front","average":{"1min":1.212,"5min":1.238,"15min":1.219},"min":{"1min":0.579,"5min":0.579,"15min":0.579},"max":{"1min":2.000,"5min":2.000,"15min":2.000},"last":1.129}]},{"osd":3,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.160,"15min":1.102},"min":{"1min":0.850,"5min":0.680,"15min":0.680},"max":{"1min":2.328,"5min":2.328,"15min":2.328},"last":0.972},{"interface":"front","average":{"1min":1.263,"5min":1.299,"15min":1.283},"min":{"1min":0.611,"5min":0.611,"15min":0.611},"max":{"1min":2.056,"5min":2.143,"15min":2.143},"last":1.089}]},{"osd":4,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":0.834,"5min":0.944,"15min":0.970},"min":{"1min":0.557,"5min":0.549,"15min":0.549},"max":{"1min":1.558,"5min":1.878,"15min":1.878},"last":0.890},{"interface":"front","average":{"1min":1.168,"5min":1.020,"15min":0.956},"min":{"1min":0.581,"5min":0.578,"15min":0.578},"max":{"1min":2.106,"5min":2.106,"15min":2.106},"last":0.836}]},{"osd":6,"last update":"Tue Dec 24 22:06:16 2019","interfaces":[{"interface":"back","average":{"1min":1.152,"5min":1.307,"15min":1.333},"min":{"1min":0.630,"5min":0.630,"15min":0.630},"max":{"1min":1.748,"5min":2.045,"15min":2.045},"last":0.538},{"interface":"front","average":{"1min":0.953,"5min":1.054,"15min":1.082},"min":{"1min":0.634,"5min":0.634,"15min":0.634},"max":{"1min":1.731,"5min":1.998,"15min":1.998},"last":0.676}]},{"osd":7,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.431,"15min":1.433},"min":{"1min":0.868,"5min":0.868,"15min":0.868},"max":{"1min":2.095,"5min":2.235,"15min":2.235},"last":1.229},{"interface":"front","average":{"1min":1.573,"5min":1.593,"15min":1.597},"min":{"1min":0.706,"5min":0.706,"15min":0.706},"max":{"1min":2.086,"5min":2.086,"15min":2.086},"last":0.774}]},{"osd":8,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.646,"5min":1.766,"15min":1.786},"min":{"1min":0.986,"5min":0.986,"15min":0.986},"max":{"1min":2.702,"5min":2.702,"15min":2.702},"last":1.661},{"interface":"front","average":{"1min":1.638,"5min":1.821,"15min":1.851},"min":{"1min":0.939,"5min":0.939,"15min":0.939},"max":{"1min":2.224,"5min":2.386,"15min":2.386},"last":1.267}]},{"osd":9,"last update":"Tue Dec 24 22:06:16 2019","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.779,"15min":1.789},"min":{"1min":1.111,"5min":1.111,"15min":1.111},"max":{"1min":2.549,"5min":2.549,"15min":2.549},"last":1.804},{"interface":"front","average":{"1min":1.708,"5min":1.823,"15min":1.842},"min":{"1min":1.159,"5min":1.159,"15min":1.159},"max":{"1min":2.493,"5min":2.493,"15min":2.493},"last":1.197}]},{"osd":10,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.735,"5min":1.735,"15min":1.735},"min":{"1min":1.214,"5min":1.214,"15min":1.214},"max":{"1min":2.640,"5min":2.640,"15min":2.640},"last":1.743},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":1.126,"5min":1.126,"15min":1.126},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.316}]}]}]}} 2019-12-24T22:06:27.493 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph pg dump --format=json 2019-12-24T22:06:29.701 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:06:29.702 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2019-12-24T22:06:30.233 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2019-12-24T22:06:28.083954+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":12,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1124941824,"kb_used":12590832,"kb_used_data":7824,"kb_used_omap":0,"kb_used_meta":12582912,"kb_avail":1112350992,"statfs":{"total":1151940427776,"available":1139047415808,"internally_reserved":12884901888,"allocated":8011776,"data_stored":3809544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12884901888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":11,"up_from":63,"seq":270582939670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.035,"5min":1.035,"15min":1.035},"min":{"1min":0.457,"5min":0.457,"15min":0.457},"max":{"1min":1.790,"5min":1.790,"15min":1.790},"last":0.759},{"interface":"front","average":{"1min":1.035,"5min":1.035,"15min":1.035},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.908,"5min":1.908,"15min":1.908},"last":1.233}]},{"osd":1,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.043,"5min":1.043,"15min":1.043},"min":{"1min":0.559,"5min":0.559,"15min":0.559},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":1.162},{"interface":"front","average":{"1min":0.920,"5min":0.920,"15min":0.920},"min":{"1min":0.591,"5min":0.591,"15min":0.591},"max":{"1min":1.539,"5min":1.539,"15min":1.539},"last":1.052}]},{"osd":2,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.946,"5min":0.946,"15min":0.946},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.059,"5min":2.059,"15min":2.059},"last":1.009},{"interface":"front","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.673,"5min":0.673,"15min":0.673},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.354}]},{"osd":3,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.140,"5min":1.140,"15min":1.140},"min":{"1min":0.518,"5min":0.518,"15min":0.518},"max":{"1min":2.138,"5min":2.138,"15min":2.138},"last":1.284},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.659,"5min":0.659,"15min":0.659},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.720}]},{"osd":4,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.965,"5min":0.965,"15min":0.965},"max":{"1min":2.013,"5min":2.013,"15min":2.013},"last":0.853},{"interface":"front","average":{"1min":1.260,"5min":1.260,"15min":1.260},"min":{"1min":0.786,"5min":0.786,"15min":0.786},"max":{"1min":2.197,"5min":2.197,"15min":2.197},"last":0.809}]},{"osd":5,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.533,"5min":1.533,"15min":1.533},"min":{"1min":1.098,"5min":1.098,"15min":1.098},"max":{"1min":2.455,"5min":2.455,"15min":2.455},"last":1.420},{"interface":"front","average":{"1min":1.350,"5min":1.350,"15min":1.350},"min":{"1min":0.674,"5min":0.674,"15min":0.674},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.962}]},{"osd":6,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.362,"5min":1.362,"15min":1.362},"min":{"1min":0.883,"5min":0.883,"15min":0.883},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.317},{"interface":"front","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":1.289,"5min":1.289,"15min":1.289},"max":{"1min":2.778,"5min":2.778,"15min":2.778},"last":1.556}]},{"osd":7,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":1.112,"5min":1.112,"15min":1.112},"max":{"1min":2.337,"5min":2.337,"15min":2.337},"last":1.388},{"interface":"front","average":{"1min":1.640,"5min":1.640,"15min":1.640},"min":{"1min":1.169,"5min":1.169,"15min":1.169},"max":{"1min":2.897,"5min":2.897,"15min":2.897},"last":1.486}]},{"osd":8,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.432,"5min":1.432,"15min":1.432},"min":{"1min":0.849,"5min":0.849,"15min":0.849},"max":{"1min":1.834,"5min":1.834,"15min":1.834},"last":1.096},{"interface":"front","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":1.076,"5min":1.076,"15min":1.076},"max":{"1min":3.173,"5min":3.173,"15min":3.173},"last":1.448}]},{"osd":10,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.461,"5min":1.461,"15min":1.461},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":1.808,"5min":1.808,"15min":1.808},"last":1.208},{"interface":"front","average":{"1min":1.701,"5min":1.701,"15min":1.701},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.985,"5min":2.985,"15min":2.985},"last":1.521}]}]},{"osd":10,"up_from":58,"seq":249108103194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.804}]},{"osd":1,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":0.965,"5min":0.965,"15min":0.965},"min":{"1min":0.573,"5min":0.573,"15min":0.573},"max":{"1min":1.612,"5min":1.612,"15min":1.612},"last":1.361},{"interface":"front","average":{"1min":0.963,"5min":0.963,"15min":0.963},"min":{"1min":0.612,"5min":0.612,"15min":0.612},"max":{"1min":1.410,"5min":1.410,"15min":1.410},"last":1.151}]},{"osd":2,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":0.985,"5min":0.985,"15min":0.985},"min":{"1min":0.575,"5min":0.575,"15min":0.575},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.678},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.645,"5min":0.645,"15min":0.645},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.736}]},{"osd":3,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.358,"5min":1.358,"15min":1.358},"min":{"1min":0.579,"5min":0.579,"15min":0.579},"max":{"1min":8.538,"5min":8.538,"15min":8.538},"last":1.237},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.655,"5min":0.655,"15min":0.655},"max":{"1min":8.477,"5min":8.477,"15min":8.477},"last":0.881}]},{"osd":4,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.328,"5min":1.328,"15min":1.328},"min":{"1min":0.802,"5min":0.802,"15min":0.802},"max":{"1min":1.815,"5min":1.815,"15min":1.815},"last":1.446},{"interface":"front","average":{"1min":1.350,"5min":1.350,"15min":1.350},"min":{"1min":0.882,"5min":0.882,"15min":0.882},"max":{"1min":1.880,"5min":1.880,"15min":1.880},"last":1.474}]},{"osd":5,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.382,"5min":1.382,"15min":1.382},"min":{"1min":0.848,"5min":0.848,"15min":0.848},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":1.518},{"interface":"front","average":{"1min":1.396,"5min":1.396,"15min":1.396},"min":{"1min":0.980,"5min":0.980,"15min":0.980},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.293}]},{"osd":6,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.750,"5min":0.750,"15min":0.750},"max":{"1min":2.063,"5min":2.063,"15min":2.063},"last":1.022},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.838,"5min":0.838,"15min":0.838},"max":{"1min":2.025,"5min":2.025,"15min":2.025},"last":0.979}]},{"osd":7,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.279,"5min":2.279,"15min":2.279},"last":1.126},{"interface":"front","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":1.224,"5min":1.224,"15min":1.224},"max":{"1min":2.125,"5min":2.125,"15min":2.125},"last":1.320}]},{"osd":8,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.558,"5min":1.558,"15min":1.558},"min":{"1min":0.888,"5min":0.888,"15min":0.888},"max":{"1min":2.178,"5min":2.178,"15min":2.178},"last":0.788},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.757,"5min":0.757,"15min":0.757},"max":{"1min":2.007,"5min":2.007,"15min":2.007},"last":1.083}]},{"osd":9,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.578,"5min":1.578,"15min":1.578},"min":{"1min":0.616,"5min":0.616,"15min":0.616},"max":{"1min":2.446,"5min":2.446,"15min":2.446},"last":1.181},{"interface":"front","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.566,"5min":0.566,"15min":0.566},"max":{"1min":2.193,"5min":2.193,"15min":2.193},"last":0.944}]},{"osd":11,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.738,"5min":1.738,"15min":1.738},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.405},{"interface":"front","average":{"1min":1.588,"5min":1.588,"15min":1.588},"min":{"1min":1.143,"5min":1.143,"15min":1.143},"max":{"1min":2.123,"5min":2.123,"15min":2.123},"last":1.608}]}]},{"osd":9,"up_from":53,"seq":227633266717,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":0.887,"5min":0.915,"15min":0.920},"min":{"1min":0.585,"5min":0.475,"15min":0.475},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":1.117},{"interface":"front","average":{"1min":0.965,"5min":0.901,"15min":0.890},"min":{"1min":0.574,"5min":0.484,"15min":0.484},"max":{"1min":2.330,"5min":2.330,"15min":2.330},"last":1.011}]},{"osd":1,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":0.856,"5min":0.841,"15min":0.839},"min":{"1min":0.562,"5min":0.562,"15min":0.562},"max":{"1min":1.482,"5min":1.660,"15min":1.660},"last":0.748},{"interface":"front","average":{"1min":1.124,"5min":1.098,"15min":1.094},"min":{"1min":0.785,"5min":0.674,"15min":0.674},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.871}]},{"osd":2,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.054,"15min":1.051},"min":{"1min":0.689,"5min":0.536,"15min":0.536},"max":{"1min":1.731,"5min":1.731,"15min":1.731},"last":1.266},{"interface":"front","average":{"1min":0.962,"5min":1.055,"15min":1.071},"min":{"1min":0.540,"5min":0.540,"15min":0.540},"max":{"1min":2.064,"5min":2.064,"15min":2.064},"last":0.597}]},{"osd":3,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.287,"5min":1.259,"15min":1.254},"min":{"1min":0.608,"5min":0.608,"15min":0.608},"max":{"1min":1.803,"5min":1.803,"15min":1.803},"last":1.575},{"interface":"front","average":{"1min":1.219,"5min":1.133,"15min":1.119},"min":{"1min":0.648,"5min":0.627,"15min":0.627},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":1.303}]},{"osd":4,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.142,"5min":0.965,"15min":0.935},"min":{"1min":0.742,"5min":0.484,"15min":0.484},"max":{"1min":1.842,"5min":1.842,"15min":1.842},"last":1.053},{"interface":"front","average":{"1min":1.480,"5min":1.348,"15min":1.326},"min":{"1min":0.872,"5min":0.803,"15min":0.803},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.338}]},{"osd":5,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.283,"5min":1.271,"15min":1.269},"min":{"1min":0.921,"5min":0.781,"15min":0.781},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":0.795},{"interface":"front","average":{"1min":1.228,"5min":1.127,"15min":1.110},"min":{"1min":1.003,"5min":0.843,"15min":0.843},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":1.168}]},{"osd":6,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.457,"5min":1.323,"15min":1.301},"min":{"1min":1.099,"5min":0.907,"15min":0.907},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.431},{"interface":"front","average":{"1min":1.376,"5min":1.238,"15min":1.215},"min":{"1min":1.041,"5min":0.751,"15min":0.751},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.371}]},{"osd":7,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.448,"15min":1.424},"min":{"1min":1.013,"5min":0.891,"15min":0.891},"max":{"1min":2.047,"5min":2.047,"15min":2.047},"last":1.467},{"interface":"front","average":{"1min":1.531,"5min":1.455,"15min":1.442},"min":{"1min":1.145,"5min":0.723,"15min":0.723},"max":{"1min":2.134,"5min":2.134,"15min":2.134},"last":1.239}]},{"osd":8,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.392,"15min":1.368},"min":{"1min":1.038,"5min":0.555,"15min":0.555},"max":{"1min":2.212,"5min":2.212,"15min":2.212},"last":0.701},{"interface":"front","average":{"1min":1.616,"5min":1.417,"15min":1.384},"min":{"1min":1.192,"5min":0.605,"15min":0.605},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":1.081}]},{"osd":10,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.315,"5min":1.315,"15min":1.315},"min":{"1min":0.865,"5min":0.865,"15min":0.865},"max":{"1min":1.713,"5min":1.713,"15min":1.713},"last":0.969},{"interface":"front","average":{"1min":1.662,"5min":1.662,"15min":1.662},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":2.128,"5min":2.128,"15min":2.128},"last":1.522}]}]},{"osd":8,"up_from":48,"seq":206158430242,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.887,"5min":0.873,"15min":0.871},"min":{"1min":0.512,"5min":0.512,"15min":0.512},"max":{"1min":1.441,"5min":2.639,"15min":2.639},"last":0.615},{"interface":"front","average":{"1min":0.795,"5min":0.792,"15min":0.792},"min":{"1min":0.480,"5min":0.480,"15min":0.480},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":1.103}]},{"osd":1,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.983,"5min":1.044,"15min":1.054},"min":{"1min":0.585,"5min":0.585,"15min":0.585},"max":{"1min":1.346,"5min":1.864,"15min":1.864},"last":1.003},{"interface":"front","average":{"1min":1.007,"5min":1.123,"15min":1.142},"min":{"1min":0.470,"5min":0.470,"15min":0.470},"max":{"1min":1.620,"5min":2.751,"15min":2.751},"last":0.930}]},{"osd":2,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.897,"5min":0.953,"15min":0.962},"min":{"1min":0.579,"5min":0.579,"15min":0.579},"max":{"1min":1.315,"5min":1.581,"15min":1.581},"last":0.829},{"interface":"front","average":{"1min":1.043,"5min":1.039,"15min":1.039},"min":{"1min":0.550,"5min":0.550,"15min":0.550},"max":{"1min":1.542,"5min":1.813,"15min":1.813},"last":0.738}]},{"osd":3,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.961,"5min":0.969,"15min":0.971},"min":{"1min":0.567,"5min":0.563,"15min":0.563},"max":{"1min":1.448,"5min":1.669,"15min":1.669},"last":0.666},{"interface":"front","average":{"1min":1.168,"5min":1.140,"15min":1.135},"min":{"1min":0.631,"5min":0.631,"15min":0.631},"max":{"1min":1.558,"5min":2.925,"15min":2.925},"last":1.060}]},{"osd":4,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.194,"15min":1.188},"min":{"1min":0.866,"5min":0.659,"15min":0.659},"max":{"1min":1.567,"5min":2.839,"15min":2.839},"last":1.223},{"interface":"front","average":{"1min":0.991,"5min":1.067,"15min":1.079},"min":{"1min":0.748,"5min":0.726,"15min":0.726},"max":{"1min":1.284,"5min":1.617,"15min":1.617},"last":1.249}]},{"osd":5,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.357,"15min":1.355},"min":{"1min":1.056,"5min":0.958,"15min":0.958},"max":{"1min":1.876,"5min":1.916,"15min":1.916},"last":1.380},{"interface":"front","average":{"1min":1.576,"5min":1.510,"15min":1.499},"min":{"1min":1.034,"5min":1.008,"15min":1.008},"max":{"1min":1.863,"5min":3.434,"15min":3.434},"last":1.442}]},{"osd":6,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.200,"15min":1.194},"min":{"1min":0.769,"5min":0.769,"15min":0.769},"max":{"1min":1.723,"5min":1.723,"15min":1.723},"last":1.704},{"interface":"front","average":{"1min":1.435,"5min":1.390,"15min":1.382},"min":{"1min":1.018,"5min":0.862,"15min":0.862},"max":{"1min":1.880,"5min":2.141,"15min":2.141},"last":1.760}]},{"osd":7,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.465,"5min":1.493,"15min":1.498},"min":{"1min":0.972,"5min":0.897,"15min":0.897},"max":{"1min":1.770,"5min":3.335,"15min":3.335},"last":1.456},{"interface":"front","average":{"1min":1.311,"5min":1.335,"15min":1.339},"min":{"1min":0.897,"5min":0.897,"15min":0.897},"max":{"1min":1.509,"5min":1.845,"15min":1.845},"last":1.631}]},{"osd":9,"last update":"Tue Dec 24 22:06:17 2019","interfaces":[{"interface":"back","average":{"1min":1.311,"5min":1.329,"15min":1.332},"min":{"1min":0.877,"5min":0.523,"15min":0.523},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.327},{"interface":"front","average":{"1min":1.332,"5min":1.289,"15min":1.282},"min":{"1min":0.797,"5min":0.693,"15min":0.693},"max":{"1min":1.729,"5min":1.747,"15min":1.747},"last":1.172}]},{"osd":10,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.390,"5min":1.390,"15min":1.390},"min":{"1min":0.854,"5min":0.854,"15min":0.854},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.583},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.705,"5min":0.705,"15min":0.705},"max":{"1min":2.257,"5min":2.257,"15min":2.257},"last":1.620}]}]},{"osd":7,"up_from":43,"seq":184683593766,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.142,"15min":1.152},"min":{"1min":0.701,"5min":0.701,"15min":0.701},"max":{"1min":1.766,"5min":2.044,"15min":2.044},"last":0.957},{"interface":"front","average":{"1min":1.085,"5min":1.129,"15min":1.136},"min":{"1min":0.652,"5min":0.630,"15min":0.630},"max":{"1min":1.942,"5min":1.954,"15min":1.954},"last":0.584}]},{"osd":1,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.186,"5min":1.015,"15min":0.987},"min":{"1min":0.686,"5min":0.567,"15min":0.567},"max":{"1min":1.688,"5min":1.688,"15min":1.688},"last":1.254},{"interface":"front","average":{"1min":1.193,"5min":1.077,"15min":1.057},"min":{"1min":0.612,"5min":0.612,"15min":0.612},"max":{"1min":1.945,"5min":1.945,"15min":1.945},"last":0.730}]},{"osd":2,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.253,"5min":1.104,"15min":1.079},"min":{"1min":0.829,"5min":0.646,"15min":0.646},"max":{"1min":1.880,"5min":2.181,"15min":2.181},"last":1.124},{"interface":"front","average":{"1min":1.137,"5min":1.133,"15min":1.132},"min":{"1min":0.780,"5min":0.592,"15min":0.592},"max":{"1min":1.813,"5min":1.813,"15min":1.813},"last":1.075}]},{"osd":3,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.185,"5min":1.135,"15min":1.127},"min":{"1min":0.684,"5min":0.636,"15min":0.636},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.662},{"interface":"front","average":{"1min":1.102,"5min":1.113,"15min":1.115},"min":{"1min":0.794,"5min":0.772,"15min":0.772},"max":{"1min":1.444,"5min":1.759,"15min":1.759},"last":0.850}]},{"osd":4,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":0.917,"5min":1.057,"15min":1.081},"min":{"1min":0.511,"5min":0.494,"15min":0.494},"max":{"1min":1.403,"5min":2.270,"15min":2.270},"last":1.036},{"interface":"front","average":{"1min":1.004,"5min":1.118,"15min":1.137},"min":{"1min":0.703,"5min":0.703,"15min":0.703},"max":{"1min":1.603,"5min":1.815,"15min":1.815},"last":1.772}]},{"osd":5,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.357,"15min":1.363},"min":{"1min":0.723,"5min":0.723,"15min":0.723},"max":{"1min":1.878,"5min":2.144,"15min":2.144},"last":1.324},{"interface":"front","average":{"1min":1.459,"5min":1.373,"15min":1.359},"min":{"1min":0.824,"5min":0.638,"15min":0.638},"max":{"1min":2.150,"5min":2.412,"15min":2.412},"last":1.175}]},{"osd":6,"last update":"Tue Dec 24 22:05:39 2019","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.497,"15min":1.515},"min":{"1min":0.869,"5min":0.869,"15min":0.869},"max":{"1min":2.447,"5min":2.668,"15min":2.668},"last":1.465},{"interface":"front","average":{"1min":1.479,"5min":1.437,"15min":1.430},"min":{"1min":0.851,"5min":0.851,"15min":0.851},"max":{"1min":2.011,"5min":2.039,"15min":2.039},"last":1.658}]},{"osd":8,"last update":"Tue Dec 24 22:06:03 2019","interfaces":[{"interface":"back","average":{"1min":1.563,"5min":1.631,"15min":1.643},"min":{"1min":0.825,"5min":0.825,"15min":0.825},"max":{"1min":2.549,"5min":2.549,"15min":2.549},"last":2.019},{"interface":"front","average":{"1min":1.528,"5min":1.608,"15min":1.621},"min":{"1min":0.965,"5min":0.965,"15min":0.965},"max":{"1min":2.215,"5min":2.442,"15min":2.442},"last":1.291}]},{"osd":9,"last update":"Tue Dec 24 22:06:16 2019","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.678,"15min":1.693},"min":{"1min":1.158,"5min":1.136,"15min":1.136},"max":{"1min":2.033,"5min":2.558,"15min":2.558},"last":1.862},{"interface":"front","average":{"1min":1.628,"5min":1.756,"15min":1.777},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":2.183,"5min":2.398,"15min":2.398},"last":1.504}]},{"osd":10,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.727,"5min":1.727,"15min":1.727},"min":{"1min":1.379,"5min":1.379,"15min":1.379},"max":{"1min":2.372,"5min":2.372,"15min":2.372},"last":2.103},{"interface":"front","average":{"1min":1.739,"5min":1.739,"15min":1.739},"min":{"1min":1.304,"5min":1.304,"15min":1.304},"max":{"1min":2.289,"5min":2.289,"15min":2.289},"last":1.580}]}]},{"osd":6,"up_from":38,"seq":163208757290,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:06:23 2019","interfaces":[{"interface":"back","average":{"1min":0.967,"5min":0.986,"15min":0.997},"min":{"1min":0.591,"5min":0.462,"15min":0.462},"max":{"1min":1.534,"5min":1.548,"15min":1.548},"last":0.964},{"interface":"front","average":{"1min":1.080,"5min":0.997,"15min":0.992},"min":{"1min":0.574,"5min":0.548,"15min":0.548},"max":{"1min":1.765,"5min":1.765,"15min":1.765},"last":0.813}]},{"osd":1,"last update":"Tue Dec 24 22:06:23 2019","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.029,"15min":0.959},"min":{"1min":0.621,"5min":0.574,"15min":0.574},"max":{"1min":1.809,"5min":7.126,"15min":7.126},"last":1.071},{"interface":"front","average":{"1min":1.107,"5min":1.092,"15min":1.016},"min":{"1min":0.851,"5min":0.677,"15min":0.677},"max":{"1min":1.488,"5min":7.085,"15min":7.085},"last":0.908}]},{"osd":2,"last update":"Tue Dec 24 22:06:23 2019","interfaces":[{"interface":"back","average":{"1min":1.203,"5min":1.133,"15min":1.117},"min":{"1min":0.836,"5min":0.688,"15min":0.688},"max":{"1min":2.060,"5min":2.060,"15min":2.060},"last":1.207},{"interface":"front","average":{"1min":1.225,"5min":1.179,"15min":1.182},"min":{"1min":0.568,"5min":0.568,"15min":0.568},"max":{"1min":1.850,"5min":2.626,"15min":2.626},"last":0.591}]},{"osd":3,"last update":"Tue Dec 24 22:06:23 2019","interfaces":[{"interface":"back","average":{"1min":1.128,"5min":1.073,"15min":1.055},"min":{"1min":0.591,"5min":0.591,"15min":0.591},"max":{"1min":2.633,"5min":2.633,"15min":2.633},"last":0.679},{"interface":"front","average":{"1min":0.999,"5min":1.100,"15min":1.153},"min":{"1min":0.653,"5min":0.591,"15min":0.591},"max":{"1min":1.692,"5min":1.692,"15min":1.692},"last":1.692}]},{"osd":4,"last update":"Tue Dec 24 22:06:23 2019","interfaces":[{"interface":"back","average":{"1min":1.126,"5min":1.124,"15min":1.123},"min":{"1min":0.641,"5min":0.485,"15min":0.485},"max":{"1min":1.731,"5min":1.731,"15min":1.731},"last":0.748},{"interface":"front","average":{"1min":1.266,"5min":1.218,"15min":1.209},"min":{"1min":0.771,"5min":0.700,"15min":0.700},"max":{"1min":1.578,"5min":2.005,"15min":2.005},"last":1.511}]},{"osd":5,"last update":"Tue Dec 24 22:06:23 2019","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.278,"15min":1.306},"min":{"1min":0.633,"5min":0.620,"15min":0.620},"max":{"1min":1.743,"5min":2.033,"15min":2.033},"last":0.870},{"interface":"front","average":{"1min":1.348,"5min":1.348,"15min":1.354},"min":{"1min":0.945,"5min":0.614,"15min":0.614},"max":{"1min":1.664,"5min":1.861,"15min":1.861},"last":1.263}]},{"osd":7,"last update":"Tue Dec 24 22:05:38 2019","interfaces":[{"interface":"back","average":{"1min":1.186,"5min":1.318,"15min":1.340},"min":{"1min":0.779,"5min":0.681,"15min":0.681},"max":{"1min":1.512,"5min":1.948,"15min":1.948},"last":1.332},{"interface":"front","average":{"1min":1.405,"5min":1.401,"15min":1.400},"min":{"1min":1.013,"5min":0.708,"15min":0.708},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":1.399}]},{"osd":8,"last update":"Tue Dec 24 22:05:58 2019","interfaces":[{"interface":"back","average":{"1min":1.615,"5min":1.699,"15min":1.713},"min":{"1min":1.200,"5min":1.200,"15min":1.200},"max":{"1min":2.000,"5min":2.450,"15min":2.450},"last":1.444},{"interface":"front","average":{"1min":1.517,"5min":1.655,"15min":1.678},"min":{"1min":1.236,"5min":1.236,"15min":1.236},"max":{"1min":1.937,"5min":2.224,"15min":2.224},"last":2.171}]},{"osd":9,"last update":"Tue Dec 24 22:06:18 2019","interfaces":[{"interface":"back","average":{"1min":1.757,"5min":1.795,"15min":1.801},"min":{"1min":1.480,"5min":1.426,"15min":1.426},"max":{"1min":2.197,"5min":2.282,"15min":2.282},"last":1.795},{"interface":"front","average":{"1min":1.654,"5min":1.683,"15min":1.688},"min":{"1min":1.339,"5min":1.115,"15min":1.115},"max":{"1min":2.808,"5min":2.808,"15min":2.808},"last":1.590}]},{"osd":10,"last update":"Tue Dec 24 22:05:38 2019","interfaces":[{"interface":"back","average":{"1min":1.814,"5min":1.814,"15min":1.814},"min":{"1min":1.465,"5min":1.465,"15min":1.465},"max":{"1min":2.603,"5min":2.603,"15min":2.603},"last":1.756},{"interface":"front","average":{"1min":1.699,"5min":1.699,"15min":1.699},"min":{"1min":1.314,"5min":1.314,"15min":1.314},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.622}]}]},{"osd":1,"up_from":12,"seq":51539607615,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:37 2019","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.748,"15min":0.670},"min":{"1min":0.611,"5min":0.406,"15min":0.406},"max":{"1min":1.267,"5min":1.491,"15min":1.491},"last":0.620},{"interface":"front","average":{"1min":0.839,"5min":0.777,"15min":0.745},"min":{"1min":0.539,"5min":0.285,"15min":0.285},"max":{"1min":1.340,"5min":1.701,"15min":1.701},"last":0.729}]},{"osd":2,"last update":"Tue Dec 24 22:06:00 2019","interfaces":[{"interface":"back","average":{"1min":0.812,"5min":0.830,"15min":0.787},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.626,"5min":1.626,"15min":1.626},"last":0.873},{"interface":"front","average":{"1min":0.926,"5min":0.789,"15min":0.772},"min":{"1min":0.538,"5min":0.538,"15min":0.538},"max":{"1min":2.075,"5min":2.075,"15min":2.075},"last":1.121}]},{"osd":3,"last update":"Tue Dec 24 22:06:14 2019","interfaces":[{"interface":"back","average":{"1min":0.919,"5min":0.902,"15min":0.819},"min":{"1min":0.521,"5min":0.515,"15min":0.515},"max":{"1min":1.728,"5min":1.866,"15min":1.866},"last":1.194},{"interface":"front","average":{"1min":1.112,"5min":1.042,"15min":0.983},"min":{"1min":0.508,"5min":0.508,"15min":0.508},"max":{"1min":2.152,"5min":2.152,"15min":2.152},"last":1.357}]},{"osd":4,"last update":"Tue Dec 24 22:05:37 2019","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.981,"15min":0.951},"min":{"1min":0.624,"5min":0.585,"15min":0.585},"max":{"1min":1.740,"5min":1.740,"15min":1.740},"last":0.983},{"interface":"front","average":{"1min":1.252,"5min":1.098,"15min":1.051},"min":{"1min":0.831,"5min":0.701,"15min":0.701},"max":{"1min":1.747,"5min":1.843,"15min":1.843},"last":1.039}]},{"osd":5,"last update":"Tue Dec 24 22:06:00 2019","interfaces":[{"interface":"back","average":{"1min":1.289,"5min":1.283,"15min":1.309},"min":{"1min":0.829,"5min":0.733,"15min":0.733},"max":{"1min":2.551,"5min":2.551,"15min":2.551},"last":0.830},{"interface":"front","average":{"1min":1.471,"5min":1.153,"15min":1.005},"min":{"1min":0.921,"5min":0.619,"15min":0.619},"max":{"1min":2.243,"5min":2.243,"15min":2.243},"last":1.625}]},{"osd":6,"last update":"Tue Dec 24 22:06:18 2019","interfaces":[{"interface":"back","average":{"1min":1.313,"5min":1.252,"15min":1.202},"min":{"1min":0.730,"5min":0.618,"15min":0.618},"max":{"1min":2.094,"5min":2.094,"15min":2.094},"last":1.090},{"interface":"front","average":{"1min":1.445,"5min":1.488,"15min":1.482},"min":{"1min":0.907,"5min":0.802,"15min":0.802},"max":{"1min":2.075,"5min":2.358,"15min":2.358},"last":1.583}]},{"osd":7,"last update":"Tue Dec 24 22:05:37 2019","interfaces":[{"interface":"back","average":{"1min":1.485,"5min":1.359,"15min":1.338},"min":{"1min":0.972,"5min":0.970,"15min":0.970},"max":{"1min":2.212,"5min":2.212,"15min":2.212},"last":1.232},{"interface":"front","average":{"1min":1.643,"5min":1.569,"15min":1.557},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":2.475,"5min":2.475,"15min":2.475},"last":1.513}]},{"osd":8,"last update":"Tue Dec 24 22:06:00 2019","interfaces":[{"interface":"back","average":{"1min":1.582,"5min":1.633,"15min":1.641},"min":{"1min":1.093,"5min":1.093,"15min":1.093},"max":{"1min":2.716,"5min":2.716,"15min":2.716},"last":0.917},{"interface":"front","average":{"1min":1.528,"5min":1.660,"15min":1.682},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":2.032,"5min":2.556,"15min":2.556},"last":1.469}]},{"osd":9,"last update":"Tue Dec 24 22:06:14 2019","interfaces":[{"interface":"back","average":{"1min":1.683,"5min":1.508,"15min":1.479},"min":{"1min":0.985,"5min":0.985,"15min":0.985},"max":{"1min":2.631,"5min":2.631,"15min":2.631},"last":1.284},{"interface":"front","average":{"1min":1.650,"5min":1.704,"15min":1.713},"min":{"1min":1.083,"5min":1.083,"15min":1.083},"max":{"1min":2.319,"5min":2.621,"15min":2.621},"last":1.542}]},{"osd":10,"last update":"Tue Dec 24 22:05:37 2019","interfaces":[{"interface":"back","average":{"1min":1.500,"5min":1.500,"15min":1.500},"min":{"1min":1.125,"5min":1.125,"15min":1.125},"max":{"1min":2.180,"5min":2.180,"15min":2.180},"last":1.412},{"interface":"front","average":{"1min":1.705,"5min":1.705,"15min":1.705},"min":{"1min":1.237,"5min":1.237,"15min":1.237},"max":{"1min":2.759,"5min":2.759,"15min":2.759},"last":1.324}]}]},{"osd":0,"up_from":7,"seq":30064771139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 24 22:05:40 2019","interfaces":[{"interface":"back","average":{"1min":0.799,"5min":0.651,"15min":0.578},"min":{"1min":0.465,"5min":0.355,"15min":0.355},"max":{"1min":1.568,"5min":1.568,"15min":1.568},"last":0.592},{"interface":"front","average":{"1min":0.903,"5min":0.782,"15min":0.672},"min":{"1min":0.478,"5min":0.437,"15min":0.437},"max":{"1min":1.428,"5min":1.505,"15min":1.505},"last":0.453}]},{"osd":2,"last update":"Tue Dec 24 22:03:53 2019","interfaces":[{"interface":"back","average":{"1min":0.700,"5min":0.667,"15min":0.661},"min":{"1min":0.512,"5min":0.371,"15min":0.371},"max":{"1min":0.944,"5min":0.944,"15min":0.944},"last":0.545},{"interface":"front","average":{"1min":0.927,"5min":0.779,"15min":0.755},"min":{"1min":0.614,"5min":0.452,"15min":0.452},"max":{"1min":1.197,"5min":1.197,"15min":1.197},"last":0.705}]},{"osd":3,"last update":"Tue Dec 24 22:06:18 2019","interfaces":[{"interface":"back","average":{"1min":0.930,"5min":0.906,"15min":0.814},"min":{"1min":0.462,"5min":0.462,"15min":0.462},"max":{"1min":1.520,"5min":2.013,"15min":2.013},"last":0.793},{"interface":"front","average":{"1min":0.772,"5min":0.847,"15min":0.843},"min":{"1min":0.452,"5min":0.452,"15min":0.452},"max":{"1min":1.420,"5min":1.580,"15min":1.580},"last":0.532}]},{"osd":4,"last update":"Tue Dec 24 22:05:40 2019","interfaces":[{"interface":"back","average":{"1min":0.963,"5min":1.045,"15min":1.046},"min":{"1min":0.671,"5min":0.571,"15min":0.571},"max":{"1min":1.496,"5min":1.577,"15min":1.577},"last":0.749},{"interface":"front","average":{"1min":1.349,"5min":1.191,"15min":1.122},"min":{"1min":0.849,"5min":0.707,"15min":0.707},"max":{"1min":1.930,"5min":1.930,"15min":1.930},"last":0.920}]},{"osd":5,"last update":"Tue Dec 24 22:05:58 2019","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.121,"15min":1.128},"min":{"1min":0.549,"5min":0.549,"15min":0.549},"max":{"1min":1.702,"5min":2.085,"15min":2.085},"last":1.205},{"interface":"front","average":{"1min":1.378,"5min":1.264,"15min":1.192},"min":{"1min":0.910,"5min":0.887,"15min":0.887},"max":{"1min":2.325,"5min":2.325,"15min":2.325},"last":1.035}]},{"osd":6,"last update":"Tue Dec 24 22:06:18 2019","interfaces":[{"interface":"back","average":{"1min":1.051,"5min":1.191,"15min":1.199},"min":{"1min":0.817,"5min":0.709,"15min":0.709},"max":{"1min":1.371,"5min":2.019,"15min":2.019},"last":0.839},{"interface":"front","average":{"1min":1.253,"5min":1.319,"15min":1.329},"min":{"1min":0.828,"5min":0.828,"15min":0.828},"max":{"1min":1.796,"5min":1.970,"15min":1.970},"last":1.077}]},{"osd":7,"last update":"Tue Dec 24 22:05:40 2019","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.307,"15min":1.321},"min":{"1min":0.750,"5min":0.750,"15min":0.750},"max":{"1min":2.114,"5min":2.114,"15min":2.114},"last":0.684},{"interface":"front","average":{"1min":1.411,"5min":1.432,"15min":1.436},"min":{"1min":0.774,"5min":0.774,"15min":0.774},"max":{"1min":2.231,"5min":2.231,"15min":2.231},"last":1.107}]},{"osd":8,"last update":"Tue Dec 24 22:05:58 2019","interfaces":[{"interface":"back","average":{"1min":1.567,"5min":1.656,"15min":1.671},"min":{"1min":1.030,"5min":1.030,"15min":1.030},"max":{"1min":3.015,"5min":3.015,"15min":3.015},"last":0.976},{"interface":"front","average":{"1min":1.444,"5min":1.484,"15min":1.490},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.771,"5min":2.771,"15min":2.771},"last":1.235}]},{"osd":9,"last update":"Tue Dec 24 22:06:18 2019","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.605,"15min":1.610},"min":{"1min":0.983,"5min":0.712,"15min":0.712},"max":{"1min":2.274,"5min":2.652,"15min":2.652},"last":1.341},{"interface":"front","average":{"1min":1.379,"5min":1.449,"15min":1.461},"min":{"1min":1.079,"5min":0.792,"15min":0.792},"max":{"1min":2.022,"5min":2.175,"15min":2.175},"last":0.997}]},{"osd":10,"last update":"Tue Dec 24 22:05:35 2019","interfaces":[{"interface":"back","average":{"1min":1.490,"5min":1.490,"15min":1.490},"min":{"1min":0.835,"5min":0.835,"15min":0.835},"max":{"1min":2.424,"5min":2.424,"15min":2.424},"last":1.273},{"interface":"front","average":{"1min":1.739,"5min":1.739,"15min":1.739},"min":{"1min":1.192,"5min":1.192,"15min":1.192},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":1.291}]},{"osd":11,"last update":"Tue Dec 24 22:05:53 2019","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.986,"5min":0.986,"15min":0.986},"max":{"1min":2.571,"5min":2.571,"15min":2.571},"last":1.155},{"interface":"front","average":{"1min":1.864,"5min":1.864,"15min":1.864},"min":{"1min":1.023,"5min":1.023,"15min":1.023},"max":{"1min":9.942,"5min":9.942,"15min":9.942},"last":1.315}]}]},{"osd":2,"up_from":17,"seq":73014444090,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:06:02 2019","interfaces":[{"interface":"back","average":{"1min":0.851,"5min":0.717,"15min":0.651},"min":{"1min":0.440,"5min":0.409,"15min":0.409},"max":{"1min":1.481,"5min":1.481,"15min":1.481},"last":0.433},{"interface":"front","average":{"1min":0.813,"5min":0.771,"15min":0.735},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.486}]},{"osd":1,"last update":"Tue Dec 24 22:06:02 2019","interfaces":[{"interface":"back","average":{"1min":0.840,"5min":0.741,"15min":0.685},"min":{"1min":0.510,"5min":0.448,"15min":0.448},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.758},{"interface":"front","average":{"1min":1.022,"5min":0.923,"15min":0.836},"min":{"1min":0.431,"5min":0.431,"15min":0.431},"max":{"1min":1.705,"5min":1.705,"15min":1.705},"last":0.838}]},{"osd":3,"last update":"Tue Dec 24 22:06:19 2019","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.873,"15min":0.785},"min":{"1min":0.513,"5min":0.513,"15min":0.513},"max":{"1min":1.687,"5min":1.687,"15min":1.687},"last":1.006},{"interface":"front","average":{"1min":1.163,"5min":0.966,"15min":0.864},"min":{"1min":0.577,"5min":0.513,"15min":0.513},"max":{"1min":1.584,"5min":1.584,"15min":1.584},"last":0.677}]},{"osd":4,"last update":"Tue Dec 24 22:05:38 2019","interfaces":[{"interface":"back","average":{"1min":1.037,"5min":0.967,"15min":0.940},"min":{"1min":0.597,"5min":0.494,"15min":0.494},"max":{"1min":1.971,"5min":1.973,"15min":1.973},"last":0.879},{"interface":"front","average":{"1min":1.140,"5min":1.069,"15min":1.045},"min":{"1min":0.551,"5min":0.551,"15min":0.551},"max":{"1min":1.615,"5min":2.039,"15min":2.039},"last":0.913}]},{"osd":5,"last update":"Tue Dec 24 22:06:02 2019","interfaces":[{"interface":"back","average":{"1min":1.539,"5min":1.253,"15min":1.161},"min":{"1min":0.912,"5min":0.788,"15min":0.788},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.470},{"interface":"front","average":{"1min":1.372,"5min":1.122,"15min":1.063},"min":{"1min":0.665,"5min":0.548,"15min":0.548},"max":{"1min":2.299,"5min":2.299,"15min":2.299},"last":1.001}]},{"osd":6,"last update":"Tue Dec 24 22:06:19 2019","interfaces":[{"interface":"back","average":{"1min":1.483,"5min":1.284,"15min":1.186},"min":{"1min":0.608,"5min":0.608,"15min":0.608},"max":{"1min":2.691,"5min":2.691,"15min":2.691},"last":1.417},{"interface":"front","average":{"1min":1.214,"5min":1.349,"15min":1.394},"min":{"1min":0.705,"5min":0.680,"15min":0.680},"max":{"1min":1.775,"5min":2.777,"15min":2.777},"last":1.082}]},{"osd":7,"last update":"Tue Dec 24 22:05:36 2019","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.566,"15min":1.563},"min":{"1min":1.135,"5min":1.135,"15min":1.135},"max":{"1min":2.150,"5min":2.190,"15min":2.190},"last":1.516},{"interface":"front","average":{"1min":1.286,"5min":1.306,"15min":1.310},"min":{"1min":0.634,"5min":0.634,"15min":0.634},"max":{"1min":1.897,"5min":1.962,"15min":1.962},"last":0.805}]},{"osd":8,"last update":"Tue Dec 24 22:06:02 2019","interfaces":[{"interface":"back","average":{"1min":1.259,"5min":1.385,"15min":1.406},"min":{"1min":0.836,"5min":0.836,"15min":0.836},"max":{"1min":2.106,"5min":2.885,"15min":2.885},"last":1.171},{"interface":"front","average":{"1min":1.654,"5min":1.724,"15min":1.736},"min":{"1min":0.981,"5min":0.981,"15min":0.981},"max":{"1min":2.614,"5min":2.614,"15min":2.614},"last":1.545}]},{"osd":9,"last update":"Tue Dec 24 22:06:14 2019","interfaces":[{"interface":"back","average":{"1min":1.745,"5min":1.796,"15min":1.804},"min":{"1min":0.909,"5min":0.909,"15min":0.909},"max":{"1min":3.137,"5min":3.137,"15min":3.137},"last":1.608},{"interface":"front","average":{"1min":1.378,"5min":1.459,"15min":1.473},"min":{"1min":0.786,"5min":0.786,"15min":0.786},"max":{"1min":2.132,"5min":2.132,"15min":2.132},"last":1.050}]},{"osd":10,"last update":"Tue Dec 24 22:05:36 2019","interfaces":[{"interface":"back","average":{"1min":1.813,"5min":1.813,"15min":1.813},"min":{"1min":1.363,"5min":1.363,"15min":1.363},"max":{"1min":2.542,"5min":2.542,"15min":2.542},"last":1.577},{"interface":"front","average":{"1min":1.517,"5min":1.517,"15min":1.517},"min":{"1min":0.941,"5min":0.941,"15min":0.941},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.133}]}]},{"osd":3,"up_from":22,"seq":94489280565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:04:18 2019","interfaces":[{"interface":"back","average":{"1min":0.605,"5min":0.621,"15min":0.623},"min":{"1min":0.400,"5min":0.400,"15min":0.400},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":1.050},{"interface":"front","average":{"1min":0.747,"5min":0.759,"15min":0.761},"min":{"1min":0.459,"5min":0.449,"15min":0.449},"max":{"1min":1.095,"5min":1.130,"15min":1.130},"last":1.150}]},{"osd":1,"last update":"Tue Dec 24 22:05:20 2019","interfaces":[{"interface":"back","average":{"1min":0.927,"5min":0.737,"15min":0.706},"min":{"1min":0.495,"5min":0.465,"15min":0.465},"max":{"1min":3.316,"5min":3.316,"15min":3.316},"last":0.930},{"interface":"front","average":{"1min":1.148,"5min":0.923,"15min":0.889},"min":{"1min":0.525,"5min":0.525,"15min":0.525},"max":{"1min":3.686,"5min":3.686,"15min":3.686},"last":0.980}]},{"osd":2,"last update":"Tue Dec 24 22:05:20 2019","interfaces":[{"interface":"back","average":{"1min":0.923,"5min":0.860,"15min":0.852},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.696,"5min":2.696,"15min":2.696},"last":0.591},{"interface":"front","average":{"1min":0.933,"5min":0.850,"15min":0.845},"min":{"1min":0.393,"5min":0.393,"15min":0.393},"max":{"1min":1.525,"5min":1.525,"15min":1.525},"last":0.707}]},{"osd":4,"last update":"Tue Dec 24 22:05:40 2019","interfaces":[{"interface":"back","average":{"1min":1.200,"5min":1.142,"15min":1.140},"min":{"1min":0.667,"5min":0.667,"15min":0.667},"max":{"1min":1.620,"5min":1.825,"15min":1.825},"last":1.086},{"interface":"front","average":{"1min":1.040,"5min":1.064,"15min":1.051},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.673}]},{"osd":5,"last update":"Tue Dec 24 22:05:54 2019","interfaces":[{"interface":"back","average":{"1min":1.428,"5min":1.294,"15min":1.237},"min":{"1min":0.806,"5min":0.806,"15min":0.806},"max":{"1min":2.799,"5min":2.799,"15min":2.799},"last":0.844},{"interface":"front","average":{"1min":1.292,"5min":1.210,"15min":1.167},"min":{"1min":0.743,"5min":0.731,"15min":0.731},"max":{"1min":2.624,"5min":2.624,"15min":2.624},"last":1.044}]},{"osd":6,"last update":"Tue Dec 24 22:05:20 2019","interfaces":[{"interface":"back","average":{"1min":1.408,"5min":1.320,"15min":1.306},"min":{"1min":0.732,"5min":0.732,"15min":0.732},"max":{"1min":3.034,"5min":3.034,"15min":3.034},"last":0.770},{"interface":"front","average":{"1min":1.370,"5min":1.266,"15min":1.248},"min":{"1min":0.917,"5min":0.861,"15min":0.861},"max":{"1min":2.370,"5min":2.370,"15min":2.370},"last":1.207}]},{"osd":7,"last update":"Tue Dec 24 22:05:40 2019","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.269,"15min":1.273},"min":{"1min":0.662,"5min":0.662,"15min":0.662},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":1.143},{"interface":"front","average":{"1min":1.683,"5min":1.520,"15min":1.493},"min":{"1min":0.707,"5min":0.707,"15min":0.707},"max":{"1min":3.368,"5min":3.368,"15min":3.368},"last":1.326}]},{"osd":8,"last update":"Tue Dec 24 22:05:54 2019","interfaces":[{"interface":"back","average":{"1min":1.580,"5min":1.690,"15min":1.708},"min":{"1min":0.639,"5min":0.639,"15min":0.639},"max":{"1min":3.927,"5min":3.927,"15min":3.927},"last":1.516},{"interface":"front","average":{"1min":1.308,"5min":1.380,"15min":1.392},"min":{"1min":0.785,"5min":0.785,"15min":0.785},"max":{"1min":2.430,"5min":2.430,"15min":2.430},"last":1.367}]},{"osd":9,"last update":"Tue Dec 24 22:06:18 2019","interfaces":[{"interface":"back","average":{"1min":1.445,"5min":1.745,"15min":1.795},"min":{"1min":0.807,"5min":0.807,"15min":0.807},"max":{"1min":2.316,"5min":3.583,"15min":3.583},"last":1.404},{"interface":"front","average":{"1min":1.294,"5min":1.530,"15min":1.569},"min":{"1min":0.600,"5min":0.600,"15min":0.600},"max":{"1min":1.936,"5min":2.914,"15min":2.914},"last":1.182}]},{"osd":10,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.862,"5min":1.862,"15min":1.862},"min":{"1min":1.110,"5min":1.110,"15min":1.110},"max":{"1min":3.759,"5min":3.759,"15min":3.759},"last":1.572},{"interface":"front","average":{"1min":1.572,"5min":1.572,"15min":1.572},"min":{"1min":0.855,"5min":0.855,"15min":0.855},"max":{"1min":3.187,"5min":3.187,"15min":3.187},"last":1.304}]},{"osd":11,"last update":"Tue Dec 24 22:05:54 2019","interfaces":[{"interface":"back","average":{"1min":1.666,"5min":1.666,"15min":1.666},"min":{"1min":1.074,"5min":1.074,"15min":1.074},"max":{"1min":2.540,"5min":2.540,"15min":2.540},"last":1.470},{"interface":"front","average":{"1min":1.602,"5min":1.602,"15min":1.602},"min":{"1min":0.866,"5min":0.866,"15min":0.866},"max":{"1min":4.079,"5min":4.079,"15min":4.079},"last":1.269}]}]},{"osd":4,"up_from":27,"seq":115964117042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.156,"5min":0.984,"15min":0.924},"min":{"1min":0.641,"5min":0.441,"15min":0.441},"max":{"1min":2.050,"5min":2.050,"15min":2.050},"last":1.485},{"interface":"front","average":{"1min":0.933,"5min":1.052,"15min":1.080},"min":{"1min":0.637,"5min":0.584,"15min":0.584},"max":{"1min":1.418,"5min":1.653,"15min":1.653},"last":0.974}]},{"osd":1,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":0.902,"5min":0.909,"15min":0.903},"min":{"1min":0.602,"5min":0.592,"15min":0.592},"max":{"1min":1.795,"5min":1.795,"15min":1.795},"last":0.778},{"interface":"front","average":{"1min":1.297,"5min":1.185,"15min":1.149},"min":{"1min":0.574,"5min":0.574,"15min":0.574},"max":{"1min":1.946,"5min":2.229,"15min":2.229},"last":1.560}]},{"osd":2,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.098,"5min":0.998,"15min":0.952},"min":{"1min":0.676,"5min":0.550,"15min":0.550},"max":{"1min":1.862,"5min":2.144,"15min":2.144},"last":0.725},{"interface":"front","average":{"1min":1.096,"5min":1.048,"15min":1.050},"min":{"1min":0.748,"5min":0.564,"15min":0.564},"max":{"1min":1.481,"5min":1.821,"15min":1.821},"last":1.081}]},{"osd":3,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.358,"5min":1.124,"15min":1.068},"min":{"1min":0.714,"5min":0.637,"15min":0.637},"max":{"1min":1.799,"5min":1.799,"15min":1.799},"last":1.275},{"interface":"front","average":{"1min":1.313,"5min":1.042,"15min":0.969},"min":{"1min":0.975,"5min":0.585,"15min":0.585},"max":{"1min":1.655,"5min":1.852,"15min":1.852},"last":1.229}]},{"osd":5,"last update":"Tue Dec 24 22:06:09 2019","interfaces":[{"interface":"back","average":{"1min":1.251,"5min":1.132,"15min":1.055},"min":{"1min":0.645,"5min":0.510,"15min":0.510},"max":{"1min":1.773,"5min":2.081,"15min":2.081},"last":1.053},{"interface":"front","average":{"1min":1.165,"5min":1.131,"15min":1.125},"min":{"1min":0.644,"5min":0.557,"15min":0.557},"max":{"1min":1.601,"5min":2.611,"15min":2.611},"last":1.372}]},{"osd":6,"last update":"Tue Dec 24 22:06:20 2019","interfaces":[{"interface":"back","average":{"1min":1.443,"5min":1.333,"15min":1.281},"min":{"1min":0.785,"5min":0.576,"15min":0.576},"max":{"1min":1.967,"5min":2.028,"15min":2.028},"last":0.870},{"interface":"front","average":{"1min":0.996,"5min":1.116,"15min":1.133},"min":{"1min":0.610,"5min":0.610,"15min":0.610},"max":{"1min":1.486,"5min":2.187,"15min":2.187},"last":0.832}]},{"osd":7,"last update":"Tue Dec 24 22:05:38 2019","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.356,"15min":1.366},"min":{"1min":0.690,"5min":0.663,"15min":0.663},"max":{"1min":1.833,"5min":1.916,"15min":1.916},"last":1.626},{"interface":"front","average":{"1min":1.324,"5min":1.341,"15min":1.344},"min":{"1min":1.049,"5min":1.042,"15min":1.042},"max":{"1min":1.714,"5min":2.336,"15min":2.336},"last":1.532}]},{"osd":8,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.692,"5min":1.742,"15min":1.750},"min":{"1min":1.262,"5min":1.245,"15min":1.245},"max":{"1min":2.341,"5min":2.341,"15min":2.341},"last":1.673},{"interface":"front","average":{"1min":1.638,"5min":1.622,"15min":1.619},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":1.942}]},{"osd":9,"last update":"Tue Dec 24 22:06:13 2019","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.442,"15min":1.454},"min":{"1min":0.961,"5min":0.946,"15min":0.946},"max":{"1min":1.764,"5min":1.827,"15min":1.827},"last":1.439},{"interface":"front","average":{"1min":1.826,"5min":1.770,"15min":1.760},"min":{"1min":1.249,"5min":1.249,"15min":1.249},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":1.768}]},{"osd":10,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.563,"5min":1.563,"15min":1.563},"min":{"1min":1.089,"5min":1.089,"15min":1.089},"max":{"1min":1.902,"5min":1.902,"15min":1.902},"last":1.328},{"interface":"front","average":{"1min":1.893,"5min":1.893,"15min":1.893},"min":{"1min":1.447,"5min":1.447,"15min":1.447},"max":{"1min":2.356,"5min":2.356,"15min":2.356},"last":1.721}]}]},{"osd":5,"up_from":32,"seq":137438953518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695916,"statfs":{"total":95995035648,"available":94920617984,"internally_reserved":1073741824,"allocated":667648,"data_stored":317462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:06:06 2019","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.888,"15min":0.830},"min":{"1min":0.630,"5min":0.466,"15min":0.466},"max":{"1min":2.180,"5min":2.180,"15min":2.180},"last":1.004},{"interface":"front","average":{"1min":1.187,"5min":1.031,"15min":0.982},"min":{"1min":0.796,"5min":0.613,"15min":0.613},"max":{"1min":2.320,"5min":2.320,"15min":2.320},"last":0.930}]},{"osd":1,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.057,"5min":1.069,"15min":1.075},"min":{"1min":0.554,"5min":0.554,"15min":0.554},"max":{"1min":1.864,"5min":1.864,"15min":1.864},"last":0.867},{"interface":"front","average":{"1min":1.133,"5min":1.140,"15min":1.136},"min":{"1min":0.601,"5min":0.601,"15min":0.601},"max":{"1min":3.438,"5min":3.438,"15min":3.438},"last":1.047}]},{"osd":2,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.158,"5min":1.122,"15min":1.120},"min":{"1min":0.527,"5min":0.527,"15min":0.527},"max":{"1min":2.248,"5min":2.248,"15min":2.248},"last":1.153},{"interface":"front","average":{"1min":1.212,"5min":1.238,"15min":1.219},"min":{"1min":0.579,"5min":0.579,"15min":0.579},"max":{"1min":2.000,"5min":2.000,"15min":2.000},"last":1.129}]},{"osd":3,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.160,"15min":1.102},"min":{"1min":0.850,"5min":0.680,"15min":0.680},"max":{"1min":2.328,"5min":2.328,"15min":2.328},"last":0.972},{"interface":"front","average":{"1min":1.263,"5min":1.299,"15min":1.283},"min":{"1min":0.611,"5min":0.611,"15min":0.611},"max":{"1min":2.056,"5min":2.143,"15min":2.143},"last":1.089}]},{"osd":4,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":0.834,"5min":0.944,"15min":0.970},"min":{"1min":0.557,"5min":0.549,"15min":0.549},"max":{"1min":1.558,"5min":1.878,"15min":1.878},"last":0.890},{"interface":"front","average":{"1min":1.168,"5min":1.020,"15min":0.956},"min":{"1min":0.581,"5min":0.578,"15min":0.578},"max":{"1min":2.106,"5min":2.106,"15min":2.106},"last":0.836}]},{"osd":6,"last update":"Tue Dec 24 22:06:16 2019","interfaces":[{"interface":"back","average":{"1min":1.152,"5min":1.307,"15min":1.333},"min":{"1min":0.630,"5min":0.630,"15min":0.630},"max":{"1min":1.748,"5min":2.045,"15min":2.045},"last":0.538},{"interface":"front","average":{"1min":0.953,"5min":1.054,"15min":1.082},"min":{"1min":0.634,"5min":0.634,"15min":0.634},"max":{"1min":1.731,"5min":1.998,"15min":1.998},"last":0.676}]},{"osd":7,"last update":"Tue Dec 24 22:05:34 2019","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.431,"15min":1.433},"min":{"1min":0.868,"5min":0.868,"15min":0.868},"max":{"1min":2.095,"5min":2.235,"15min":2.235},"last":1.229},{"interface":"front","average":{"1min":1.573,"5min":1.593,"15min":1.597},"min":{"1min":0.706,"5min":0.706,"15min":0.706},"max":{"1min":2.086,"5min":2.086,"15min":2.086},"last":0.774}]},{"osd":8,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.646,"5min":1.766,"15min":1.786},"min":{"1min":0.986,"5min":0.986,"15min":0.986},"max":{"1min":2.702,"5min":2.702,"15min":2.702},"last":1.661},{"interface":"front","average":{"1min":1.638,"5min":1.821,"15min":1.851},"min":{"1min":0.939,"5min":0.939,"15min":0.939},"max":{"1min":2.224,"5min":2.386,"15min":2.386},"last":1.267}]},{"osd":9,"last update":"Tue Dec 24 22:06:16 2019","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.779,"15min":1.789},"min":{"1min":1.111,"5min":1.111,"15min":1.111},"max":{"1min":2.549,"5min":2.549,"15min":2.549},"last":1.804},{"interface":"front","average":{"1min":1.708,"5min":1.823,"15min":1.842},"min":{"1min":1.159,"5min":1.159,"15min":1.159},"max":{"1min":2.493,"5min":2.493,"15min":2.493},"last":1.197}]},{"osd":10,"last update":"Tue Dec 24 22:05:33 2019","interfaces":[{"interface":"back","average":{"1min":1.735,"5min":1.735,"15min":1.735},"min":{"1min":1.214,"5min":1.214,"15min":1.214},"max":{"1min":2.640,"5min":2.640,"15min":2.640},"last":1.743},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":1.126,"5min":1.126,"15min":1.126},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.316}]}]}]}} 2019-12-24T22:06:30.239 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2019-12-24T22:06:30.239 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump 2019-12-24T22:06:32.554 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 76 2019-12-24T22:06:32.554 INFO:teuthology.orchestra.run.smithi037.stdout:fsid 4a02c23c-2698-11ea-8286-001a4aab830c 2019-12-24T22:06:32.555 INFO:teuthology.orchestra.run.smithi037.stdout:created 2019-12-24T21:57:38.639659+0000 2019-12-24T22:06:32.555 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2019-12-24T22:06:32.152783+0000 2019-12-24T22:06:32.555 INFO:teuthology.orchestra.run.smithi037.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2019-12-24T22:06:32.555 INFO:teuthology.orchestra.run.smithi037.stdout:crush_version 25 2019-12-24T22:06:32.555 INFO:teuthology.orchestra.run.smithi037.stdout:full_ratio 0.95 2019-12-24T22:06:32.555 INFO:teuthology.orchestra.run.smithi037.stdout:backfillfull_ratio 0.9 2019-12-24T22:06:32.555 INFO:teuthology.orchestra.run.smithi037.stdout:nearfull_ratio 0.85 2019-12-24T22:06:32.556 INFO:teuthology.orchestra.run.smithi037.stdout:require_min_compat_client jewel 2019-12-24T22:06:32.556 INFO:teuthology.orchestra.run.smithi037.stdout:min_compat_client jewel 2019-12-24T22:06:32.556 INFO:teuthology.orchestra.run.smithi037.stdout:require_osd_release octopus 2019-12-24T22:06:32.556 INFO:teuthology.orchestra.run.smithi037.stdout:max_osd 12 2019-12-24T22:06:32.556 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 up in weight 1 up_from 7 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6802/1,v1:172.21.15.37:6803/1] [v2:172.21.15.37:6804/1,v1:172.21.15.37:6805/1] exists,up c799ce4a-3bc5-41f4-8204-14b2dcdaebff 2019-12-24T22:06:32.557 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 up in weight 1 up_from 12 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6810/1,v1:172.21.15.37:6811/1] [v2:172.21.15.37:6812/1,v1:172.21.15.37:6813/1] exists,up 916a5b5f-cf2b-46be-89f6-fdba5a7c0209 2019-12-24T22:06:32.557 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 up in weight 1 up_from 17 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6818/1,v1:172.21.15.37:6819/1] [v2:172.21.15.37:6820/1,v1:172.21.15.37:6821/1] exists,up 419d02f1-c9b3-417b-ba4d-b58349a58904 2019-12-24T22:06:32.557 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6826/1,v1:172.21.15.37:6827/1] [v2:172.21.15.37:6828/1,v1:172.21.15.37:6829/1] exists,up 9836824f-ba9f-4f57-b1b1-102518a6bd16 2019-12-24T22:06:32.557 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 up in weight 1 up_from 27 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6800/1,v1:172.21.15.6:6801/1] [v2:172.21.15.6:6802/1,v1:172.21.15.6:6803/1] exists,up 8362ed26-8b70-4b97-a76c-35b6d0d1baad 2019-12-24T22:06:32.557 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 up in weight 1 up_from 32 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6808/1,v1:172.21.15.6:6809/1] [v2:172.21.15.6:6810/1,v1:172.21.15.6:6811/1] exists,up 61719885-3438-45cb-9d5e-9a6f2597cd07 2019-12-24T22:06:32.557 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6 up in weight 1 up_from 38 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6816/1,v1:172.21.15.6:6817/1] [v2:172.21.15.6:6818/1,v1:172.21.15.6:6819/1] exists,up 4d49e020-db19-42d8-8488-434ef5fc294a 2019-12-24T22:06:32.557 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7 up in weight 1 up_from 43 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6824/1,v1:172.21.15.6:6825/1] [v2:172.21.15.6:6826/1,v1:172.21.15.6:6827/1] exists,up 15d86808-448c-4422-863c-8a1e7c63f269 2019-12-24T22:06:32.558 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8 up in weight 1 up_from 48 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.124:6800/1,v1:172.21.15.124:6801/1] [v2:172.21.15.124:6802/1,v1:172.21.15.124:6803/1] exists,up 1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3 2019-12-24T22:06:32.558 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9 up in weight 1 up_from 53 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.124:6808/1,v1:172.21.15.124:6809/1] [v2:172.21.15.124:6810/1,v1:172.21.15.124:6811/1] exists,up b0793d47-cd8b-465c-83ae-505462844757 2019-12-24T22:06:32.558 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10 up in weight 1 up_from 58 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.124:6816/1,v1:172.21.15.124:6817/1] [v2:172.21.15.124:6818/1,v1:172.21.15.124:6819/1] exists,up 053340b7-e591-4649-af97-917c0e99b0a0 2019-12-24T22:06:32.558 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11 up in weight 1 up_from 63 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.124:6824/1,v1:172.21.15.124:6825/1] [v2:172.21.15.124:6826/1,v1:172.21.15.124:6827/1] exists,up 05ace7ae-7d6a-43dc-a444-9958ec67e9bc 2019-12-24T22:06:32.558 INFO:teuthology.orchestra.run.smithi037.stdout:blacklist 172.21.15.37:6801/1 expires 2019-12-25T21:57:55.699433+0000 2019-12-24T22:06:32.558 INFO:teuthology.orchestra.run.smithi037.stdout:blacklist 172.21.15.37:6800/1 expires 2019-12-25T21:57:55.699433+0000 2019-12-24T22:06:33.105 INFO:tasks.cephadm.ceph_manager.ceph:['osd.0 up in weight 1 up_from 7 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6802/1,v1:172.21.15.37:6803/1] [v2:172.21.15.37:6804/1,v1:172.21.15.37:6805/1] exists,up c799ce4a-3bc5-41f4-8204-14b2dcdaebff', 'osd.1 up in weight 1 up_from 12 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6810/1,v1:172.21.15.37:6811/1] [v2:172.21.15.37:6812/1,v1:172.21.15.37:6813/1] exists,up 916a5b5f-cf2b-46be-89f6-fdba5a7c0209', 'osd.2 up in weight 1 up_from 17 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6818/1,v1:172.21.15.37:6819/1] [v2:172.21.15.37:6820/1,v1:172.21.15.37:6821/1] exists,up 419d02f1-c9b3-417b-ba4d-b58349a58904', 'osd.3 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6826/1,v1:172.21.15.37:6827/1] [v2:172.21.15.37:6828/1,v1:172.21.15.37:6829/1] exists,up 9836824f-ba9f-4f57-b1b1-102518a6bd16', 'osd.4 up in weight 1 up_from 27 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6800/1,v1:172.21.15.6:6801/1] [v2:172.21.15.6:6802/1,v1:172.21.15.6:6803/1] exists,up 8362ed26-8b70-4b97-a76c-35b6d0d1baad', 'osd.5 up in weight 1 up_from 32 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6808/1,v1:172.21.15.6:6809/1] [v2:172.21.15.6:6810/1,v1:172.21.15.6:6811/1] exists,up 61719885-3438-45cb-9d5e-9a6f2597cd07', 'osd.6 up in weight 1 up_from 38 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6816/1,v1:172.21.15.6:6817/1] [v2:172.21.15.6:6818/1,v1:172.21.15.6:6819/1] exists,up 4d49e020-db19-42d8-8488-434ef5fc294a', 'osd.7 up in weight 1 up_from 43 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6824/1,v1:172.21.15.6:6825/1] [v2:172.21.15.6:6826/1,v1:172.21.15.6:6827/1] exists,up 15d86808-448c-4422-863c-8a1e7c63f269', 'osd.8 up in weight 1 up_from 48 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.124:6800/1,v1:172.21.15.124:6801/1] [v2:172.21.15.124:6802/1,v1:172.21.15.124:6803/1] exists,up 1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3', 'osd.9 up in weight 1 up_from 53 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.124:6808/1,v1:172.21.15.124:6809/1] [v2:172.21.15.124:6810/1,v1:172.21.15.124:6811/1] exists,up b0793d47-cd8b-465c-83ae-505462844757', 'osd.10 up in weight 1 up_from 58 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.124:6816/1,v1:172.21.15.124:6817/1] [v2:172.21.15.124:6818/1,v1:172.21.15.124:6819/1] exists,up 053340b7-e591-4649-af97-917c0e99b0a0', 'osd.11 up in weight 1 up_from 63 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.124:6824/1,v1:172.21.15.124:6825/1] [v2:172.21.15.124:6826/1,v1:172.21.15.124:6827/1] exists,up 05ace7ae-7d6a-43dc-a444-9958ec67e9bc'] 2019-12-24T22:06:33.105 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon mon.a config show 2019-12-24T22:06:35.214 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2019-12-24T22:06:35.214 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mon.a", 2019-12-24T22:06:35.214 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster": "ceph", 2019-12-24T22:06:35.214 INFO:teuthology.orchestra.run.smithi037.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2019-12-24T22:06:35.214 INFO:teuthology.orchestra.run.smithi037.stdout: "admin_socket_mode": "", 2019-12-24T22:06:35.214 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ansi": "Terminal", 2019-12-24T22:06:35.215 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_client_required": "cephx, none", 2019-12-24T22:06:35.215 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_cluster_required": "cephx", 2019-12-24T22:06:35.215 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_debug": "true", 2019-12-24T22:06:35.215 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_mon_ticket_ttl": "43200.000000", 2019-12-24T22:06:35.215 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_service_required": "cephx", 2019-12-24T22:06:35.215 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_service_ticket_ttl": "3600.000000", 2019-12-24T22:06:35.215 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_supported": "", 2019-12-24T22:06:35.216 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_aio": "true", 2019-12-24T22:06:35.216 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_aio_max_queue_depth": "1024", 2019-12-24T22:06:35.216 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_aio_poll_ms": "250", 2019-12-24T22:06:35.216 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_aio_reap_max": "16", 2019-12-24T22:06:35.216 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_async_discard": "false", 2019-12-24T22:06:35.216 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_block_size": "4096", 2019-12-24T22:06:35.217 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_debug_aio": "false", 2019-12-24T22:06:35.217 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_debug_aio_log_age": "5.000000", 2019-12-24T22:06:35.217 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2019-12-24T22:06:35.217 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_debug_inflight_ios": "false", 2019-12-24T22:06:35.217 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_enable_discard": "false", 2019-12-24T22:06:35.217 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_inject_crash": "0", 2019-12-24T22:06:35.217 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_inject_crash_flush_delay": "2", 2019-12-24T22:06:35.218 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_nvme_retry_count": "-1", 2019-12-24T22:06:35.218 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_nvme_unbind_from_kernel": "false", 2019-12-24T22:06:35.218 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_alloc_size": "1048576", 2019-12-24T22:06:35.218 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_allocator": "bitmap", 2019-12-24T22:06:35.218 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_buffered_io": "true", 2019-12-24T22:06:35.218 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_compact_log_sync": "false", 2019-12-24T22:06:35.218 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2019-12-24T22:06:35.219 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_log_compact_min_size": "16777216", 2019-12-24T22:06:35.219 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_log_replay_check_allocations": "true", 2019-12-24T22:06:35.219 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_max_log_runway": "4194304", 2019-12-24T22:06:35.219 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_max_prefetch": "1048576", 2019-12-24T22:06:35.219 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_min_flush_size": "524288", 2019-12-24T22:06:35.219 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_min_log_runway": "1048576", 2019-12-24T22:06:35.219 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_preextend_wal_files": "true", 2019-12-24T22:06:35.220 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_shared_alloc_size": "65536", 2019-12-24T22:06:35.220 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_sync_write": "false", 2019-12-24T22:06:35.220 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2019-12-24T22:06:35.220 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2019-12-24T22:06:35.220 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_allocator": "bitmap", 2019-12-24T22:06:35.220 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2019-12-24T22:06:35.220 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2019-12-24T22:06:35.221 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2019-12-24T22:06:35.221 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bitmapallocator_span_size": "1024", 2019-12-24T22:06:35.221 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blobid_prealloc": "10240", 2019-12-24T22:06:35.221 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_create": "true", 2019-12-24T22:06:35.222 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_db_create": "false", 2019-12-24T22:06:35.222 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_db_path": "", 2019-12-24T22:06:35.222 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_db_size": "0", 2019-12-24T22:06:35.222 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_path": "", 2019-12-24T22:06:35.222 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_preallocate_file": "false", 2019-12-24T22:06:35.222 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_size": "107374182400", 2019-12-24T22:06:35.222 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_wal_create": "false", 2019-12-24T22:06:35.223 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_wal_path": "", 2019-12-24T22:06:35.223 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_wal_size": "100663296", 2019-12-24T22:06:35.223 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bluefs": "true", 2019-12-24T22:06:35.223 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2019-12-24T22:06:35.223 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bluefs_balance_interval": "1.000000", 2019-12-24T22:06:35.223 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bluefs_db_compatibility": "true", 2019-12-24T22:06:35.223 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bluefs_env_mirror": "false", 2019-12-24T22:06:35.224 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bluefs_gift_ratio": "0.020000", 2019-12-24T22:06:35.224 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bluefs_max_free": "10737418240", 2019-12-24T22:06:35.224 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bluefs_max_ratio": "0.900000", 2019-12-24T22:06:35.224 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bluefs_min": "1073741824", 2019-12-24T22:06:35.224 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bluefs_min_free": "1073741824", 2019-12-24T22:06:35.224 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bluefs_min_ratio": "0.020000", 2019-12-24T22:06:35.224 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bluefs_reclaim_ratio": "0.200000", 2019-12-24T22:06:35.224 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_autotune": "true", 2019-12-24T22:06:35.225 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_autotune_interval": "5.000000", 2019-12-24T22:06:35.225 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_kv_ratio": "0.400000", 2019-12-24T22:06:35.225 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_ratio": "0.400000", 2019-12-24T22:06:35.225 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_size": "0", 2019-12-24T22:06:35.225 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_size_hdd": "1073741824", 2019-12-24T22:06:35.225 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_size_ssd": "3221225472", 2019-12-24T22:06:35.226 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_trim_interval": "0.050000", 2019-12-24T22:06:35.226 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_trim_max_skip_pinned": "64", 2019-12-24T22:06:35.226 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_type": "2q", 2019-12-24T22:06:35.226 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_clone_cow": "true", 2019-12-24T22:06:35.226 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_algorithm": "snappy", 2019-12-24T22:06:35.226 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_max_blob_size": "0", 2019-12-24T22:06:35.226 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_max_blob_size_hdd": "524288", 2019-12-24T22:06:35.226 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2019-12-24T22:06:35.227 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_min_blob_size": "0", 2019-12-24T22:06:35.227 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_min_blob_size_hdd": "131072", 2019-12-24T22:06:35.227 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_min_blob_size_ssd": "8192", 2019-12-24T22:06:35.227 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_mode": "none", 2019-12-24T22:06:35.228 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_required_ratio": "0.875000", 2019-12-24T22:06:35.228 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_csum_type": "crc32c", 2019-12-24T22:06:35.228 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_enforce_settings": "default", 2019-12-24T22:06:35.228 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_freelist": "false", 2019-12-24T22:06:35.228 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_fsck_abort": "false", 2019-12-24T22:06:35.229 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_inject_bug21040": "false", 2019-12-24T22:06:35.229 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2019-12-24T22:06:35.229 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_inject_read_err": "false", 2019-12-24T22:06:35.229 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_misc": "false", 2019-12-24T22:06:35.229 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_no_reuse_blocks": "false", 2019-12-24T22:06:35.229 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_omit_block_device_write": "false", 2019-12-24T22:06:35.229 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_omit_kv_commit": "false", 2019-12-24T22:06:35.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2019-12-24T22:06:35.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_prefill": "0.000000", 2019-12-24T22:06:35.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_prefragment_max": "1048576", 2019-12-24T22:06:35.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_random_read_err": "0.000000", 2019-12-24T22:06:35.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2019-12-24T22:06:35.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_small_allocations": "0", 2019-12-24T22:06:35.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2019-12-24T22:06:35.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_default_buffered_read": "true", 2019-12-24T22:06:35.231 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_default_buffered_write": "false", 2019-12-24T22:06:35.231 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_deferred_batch_ops": "0", 2019-12-24T22:06:35.231 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2019-12-24T22:06:35.231 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2019-12-24T22:06:35.231 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2019-12-24T22:06:35.231 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_map_shard_max_size": "1200", 2019-12-24T22:06:35.231 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_map_shard_min_size": "150", 2019-12-24T22:06:35.232 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_map_shard_target_size": "500", 2019-12-24T22:06:35.232 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2019-12-24T22:06:35.232 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_freelist_blocks_per_key": "128", 2019-12-24T22:06:35.232 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2019-12-24T22:06:35.232 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2019-12-24T22:06:35.232 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_on_mkfs": "true", 2019-12-24T22:06:35.232 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2019-12-24T22:06:35.233 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_on_mount": "false", 2019-12-24T22:06:35.233 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_on_mount_deep": "false", 2019-12-24T22:06:35.233 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_on_umount": "false", 2019-12-24T22:06:35.233 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_on_umount_deep": "false", 2019-12-24T22:06:35.233 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_quick_fix_on_mount": "true", 2019-12-24T22:06:35.233 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_quick_fix_threads": "2", 2019-12-24T22:06:35.233 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2019-12-24T22:06:35.234 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_gc_enable_blob_threshold": "0", 2019-12-24T22:06:35.234 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_gc_enable_total_threshold": "0", 2019-12-24T22:06:35.234 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_ignore_data_csum": "false", 2019-12-24T22:06:35.234 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_ioring": "false", 2019-12-24T22:06:35.234 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_kvbackend": "rocksdb", 2019-12-24T22:06:35.234 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_log_collection_list_age": "60.000000", 2019-12-24T22:06:35.234 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2019-12-24T22:06:35.235 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_log_op_age": "5.000000", 2019-12-24T22:06:35.235 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_max_alloc_size": "0", 2019-12-24T22:06:35.235 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_max_blob_size": "0", 2019-12-24T22:06:35.235 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_max_blob_size_hdd": "524288", 2019-12-24T22:06:35.235 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_max_blob_size_ssd": "65536", 2019-12-24T22:06:35.235 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_max_defer_interval": "3.000000", 2019-12-24T22:06:35.236 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_max_deferred_txc": "32", 2019-12-24T22:06:35.236 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_min_alloc_size": "0", 2019-12-24T22:06:35.236 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_min_alloc_size_hdd": "4096", 2019-12-24T22:06:35.236 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_min_alloc_size_ssd": "4096", 2019-12-24T22:06:35.236 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_nid_prealloc": "1024", 2019-12-24T22:06:35.236 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_prefer_deferred_size": "0", 2019-12-24T22:06:35.236 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_prefer_deferred_size_hdd": "32768", 2019-12-24T22:06:35.237 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2019-12-24T22:06:35.237 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_retry_disk_reads": "3", 2019-12-24T22:06:35.237 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_rocksdb_cf": "false", 2019-12-24T22:06:35.237 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_rocksdb_cfs": "M= P= L=", 2019-12-24T22:06:35.237 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_rocksdb_options": "compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2", 2019-12-24T22:06:35.237 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_spdk_coremask": "0x1", 2019-12-24T22:06:35.238 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_spdk_io_sleep": "5", 2019-12-24T22:06:35.238 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_spdk_max_io_completion": "0", 2019-12-24T22:06:35.238 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_spdk_mem": "512", 2019-12-24T22:06:35.238 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_sync_submit_transaction": "false", 2019-12-24T22:06:35.238 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_throttle_bytes": "67108864", 2019-12-24T22:06:35.238 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_throttle_cost_per_io": "0", 2019-12-24T22:06:35.238 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2019-12-24T22:06:35.239 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2019-12-24T22:06:35.239 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2019-12-24T22:06:35.239 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_throttle_trace_rate": "0.000000", 2019-12-24T22:06:35.239 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_tracing": "false", 2019-12-24T22:06:35.239 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_volume_selection_policy": "rocksdb_original", 2019-12-24T22:06:35.239 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_volume_selection_reserved": "0", 2019-12-24T22:06:35.239 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2019-12-24T22:06:35.240 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2019-12-24T22:06:35.240 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_warn_on_legacy_statfs": "true", 2019-12-24T22:06:35.240 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2019-12-24T22:06:35.240 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_path": "/usr/sbin/cephadm", 2019-12-24T22:06:35.240 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_cluster_require_signatures": "false", 2019-12-24T22:06:35.240 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_cluster_require_version": "1", 2019-12-24T22:06:35.240 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_require_signatures": "false", 2019-12-24T22:06:35.241 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_require_version": "1", 2019-12-24T22:06:35.241 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_service_require_signatures": "false", 2019-12-24T22:06:35.241 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_service_require_version": "1", 2019-12-24T22:06:35.241 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_sign_messages": "true", 2019-12-24T22:06:35.241 INFO:teuthology.orchestra.run.smithi037.stdout: "chdir": "", 2019-12-24T22:06:35.241 INFO:teuthology.orchestra.run.smithi037.stdout: "client_acl_type": "", 2019-12-24T22:06:35.241 INFO:teuthology.orchestra.run.smithi037.stdout: "client_cache_mid": "0.750000", 2019-12-24T22:06:35.242 INFO:teuthology.orchestra.run.smithi037.stdout: "client_cache_size": "16384", 2019-12-24T22:06:35.242 INFO:teuthology.orchestra.run.smithi037.stdout: "client_caps_release_delay": "5", 2019-12-24T22:06:35.242 INFO:teuthology.orchestra.run.smithi037.stdout: "client_check_pool_perm": "true", 2019-12-24T22:06:35.242 INFO:teuthology.orchestra.run.smithi037.stdout: "client_debug_force_sync_read": "false", 2019-12-24T22:06:35.242 INFO:teuthology.orchestra.run.smithi037.stdout: "client_debug_getattr_caps": "false", 2019-12-24T22:06:35.242 INFO:teuthology.orchestra.run.smithi037.stdout: "client_debug_inject_tick_delay": "0", 2019-12-24T22:06:35.242 INFO:teuthology.orchestra.run.smithi037.stdout: "client_die_on_failed_dentry_invalidate": "true", 2019-12-24T22:06:35.243 INFO:teuthology.orchestra.run.smithi037.stdout: "client_die_on_failed_remount": "false", 2019-12-24T22:06:35.243 INFO:teuthology.orchestra.run.smithi037.stdout: "client_dirsize_rbytes": "true", 2019-12-24T22:06:35.244 INFO:teuthology.orchestra.run.smithi037.stdout: "client_force_lazyio": "false", 2019-12-24T22:06:35.244 INFO:teuthology.orchestra.run.smithi037.stdout: "client_inject_fixed_oldest_tid": "false", 2019-12-24T22:06:35.244 INFO:teuthology.orchestra.run.smithi037.stdout: "client_inject_release_failure": "false", 2019-12-24T22:06:35.244 INFO:teuthology.orchestra.run.smithi037.stdout: "client_max_inline_size": "4096", 2019-12-24T22:06:35.244 INFO:teuthology.orchestra.run.smithi037.stdout: "client_mds_namespace": "", 2019-12-24T22:06:35.244 INFO:teuthology.orchestra.run.smithi037.stdout: "client_metadata": "", 2019-12-24T22:06:35.245 INFO:teuthology.orchestra.run.smithi037.stdout: "client_mount_gid": "-1", 2019-12-24T22:06:35.245 INFO:teuthology.orchestra.run.smithi037.stdout: "client_mount_timeout": "300.000000", 2019-12-24T22:06:35.245 INFO:teuthology.orchestra.run.smithi037.stdout: "client_mount_uid": "-1", 2019-12-24T22:06:35.245 INFO:teuthology.orchestra.run.smithi037.stdout: "client_mountpoint": "/", 2019-12-24T22:06:35.245 INFO:teuthology.orchestra.run.smithi037.stdout: "client_notify_timeout": "10", 2019-12-24T22:06:35.245 INFO:teuthology.orchestra.run.smithi037.stdout: "client_oc": "true", 2019-12-24T22:06:35.246 INFO:teuthology.orchestra.run.smithi037.stdout: "client_oc_max_dirty": "104857600", 2019-12-24T22:06:35.246 INFO:teuthology.orchestra.run.smithi037.stdout: "client_oc_max_dirty_age": "5.000000", 2019-12-24T22:06:35.246 INFO:teuthology.orchestra.run.smithi037.stdout: "client_oc_max_objects": "1000", 2019-12-24T22:06:35.246 INFO:teuthology.orchestra.run.smithi037.stdout: "client_oc_size": "209715200", 2019-12-24T22:06:35.246 INFO:teuthology.orchestra.run.smithi037.stdout: "client_oc_target_dirty": "8388608", 2019-12-24T22:06:35.246 INFO:teuthology.orchestra.run.smithi037.stdout: "client_permissions": "true", 2019-12-24T22:06:35.246 INFO:teuthology.orchestra.run.smithi037.stdout: "client_quota_df": "true", 2019-12-24T22:06:35.246 INFO:teuthology.orchestra.run.smithi037.stdout: "client_readahead_max_bytes": "0", 2019-12-24T22:06:35.247 INFO:teuthology.orchestra.run.smithi037.stdout: "client_readahead_max_periods": "4", 2019-12-24T22:06:35.247 INFO:teuthology.orchestra.run.smithi037.stdout: "client_readahead_min": "131072", 2019-12-24T22:06:35.247 INFO:teuthology.orchestra.run.smithi037.stdout: "client_reconnect_stale": "false", 2019-12-24T22:06:35.247 INFO:teuthology.orchestra.run.smithi037.stdout: "client_snapdir": ".snap", 2019-12-24T22:06:35.247 INFO:teuthology.orchestra.run.smithi037.stdout: "client_tick_interval": "1.000000", 2019-12-24T22:06:35.247 INFO:teuthology.orchestra.run.smithi037.stdout: "client_trace": "", 2019-12-24T22:06:35.247 INFO:teuthology.orchestra.run.smithi037.stdout: "client_try_dentry_invalidate": "false", 2019-12-24T22:06:35.248 INFO:teuthology.orchestra.run.smithi037.stdout: "client_use_faked_inos": "false", 2019-12-24T22:06:35.248 INFO:teuthology.orchestra.run.smithi037.stdout: "client_use_random_mds": "false", 2019-12-24T22:06:35.248 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_graylog": "false", 2019-12-24T22:06:35.248 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_graylog_host": "127.0.0.1", 2019-12-24T22:06:35.248 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_graylog_port": "12201", 2019-12-24T22:06:35.248 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_monitors": "default=true", 2019-12-24T22:06:35.248 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_syslog": "false", 2019-12-24T22:06:35.249 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2019-12-24T22:06:35.249 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_syslog_level": "info", 2019-12-24T22:06:35.249 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addr": "-", 2019-12-24T22:06:35.249 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_network": "", 2019-12-24T22:06:35.249 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_network_interface": "", 2019-12-24T22:06:35.249 INFO:teuthology.orchestra.run.smithi037.stdout: "colors": "Terminal", 2019-12-24T22:06:35.249 INFO:teuthology.orchestra.run.smithi037.stdout: "compressor_zlib_isal": "false", 2019-12-24T22:06:35.250 INFO:teuthology.orchestra.run.smithi037.stdout: "compressor_zlib_level": "5", 2019-12-24T22:06:35.250 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image": "quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01", 2019-12-24T22:06:35.250 INFO:teuthology.orchestra.run.smithi037.stdout: "continuation_prompt": ">", 2019-12-24T22:06:35.250 INFO:teuthology.orchestra.run.smithi037.stdout: "crash_dir": "/var/lib/ceph/crash", 2019-12-24T22:06:35.250 INFO:teuthology.orchestra.run.smithi037.stdout: "crimson_osd_obc_lru_size": "10", 2019-12-24T22:06:35.250 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_location": "", 2019-12-24T22:06:35.250 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_location_hook": "", 2019-12-24T22:06:35.251 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_location_hook_timeout": "10", 2019-12-24T22:06:35.251 INFO:teuthology.orchestra.run.smithi037.stdout: "daemonize": "false", 2019-12-24T22:06:35.251 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_allow_any_pool_priority": "false", 2019-12-24T22:06:35.251 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_asok": "1/5", 2019-12-24T22:06:35.251 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_asok_assert_abort": "false", 2019-12-24T22:06:35.251 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_asserts_on_shutdown": "true", 2019-12-24T22:06:35.251 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_auth": "1/5", 2019-12-24T22:06:35.252 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_bdev": "1/3", 2019-12-24T22:06:35.252 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_bluefs": "1/5", 2019-12-24T22:06:35.252 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_bluestore": "1/5", 2019-12-24T22:06:35.252 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_buffer": "0/1", 2019-12-24T22:06:35.252 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_civetweb": "1/10", 2019-12-24T22:06:35.252 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_client": "0/5", 2019-12-24T22:06:35.252 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_compressor": "1/5", 2019-12-24T22:06:35.253 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_context": "0/1", 2019-12-24T22:06:35.253 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_crush": "1/1", 2019-12-24T22:06:35.253 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_crypto": "1/5", 2019-12-24T22:06:35.253 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_deliberately_leak_memory": "false", 2019-12-24T22:06:35.253 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_disable_randomized_ping": "false", 2019-12-24T22:06:35.253 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_dpdk": "1/5", 2019-12-24T22:06:35.253 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_eventtrace": "1/5", 2019-12-24T22:06:35.254 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_filer": "0/1", 2019-12-24T22:06:35.254 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_filestore": "1/3", 2019-12-24T22:06:35.254 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_finisher": "1/1", 2019-12-24T22:06:35.254 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_fuse": "1/5", 2019-12-24T22:06:35.254 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_heartbeat_testing_span": "0", 2019-12-24T22:06:35.254 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_heartbeatmap": "1/5", 2019-12-24T22:06:35.254 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_immutable_obj_cache": "0/5", 2019-12-24T22:06:35.254 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_javaclient": "1/5", 2019-12-24T22:06:35.255 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_journal": "1/3", 2019-12-24T22:06:35.255 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_journaler": "0/5", 2019-12-24T22:06:35.255 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_kstore": "1/5", 2019-12-24T22:06:35.255 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_leveldb": "4/5", 2019-12-24T22:06:35.255 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_lockdep": "0/1", 2019-12-24T22:06:35.255 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mds": "1/5", 2019-12-24T22:06:35.256 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mds_balancer": "1/5", 2019-12-24T22:06:35.256 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mds_locker": "1/5", 2019-12-24T22:06:35.256 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mds_log": "1/5", 2019-12-24T22:06:35.256 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mds_log_expire": "1/5", 2019-12-24T22:06:35.256 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mds_migrator": "1/5", 2019-12-24T22:06:35.256 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_memdb": "4/5", 2019-12-24T22:06:35.257 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mgr": "1/5", 2019-12-24T22:06:35.257 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mgrc": "1/5", 2019-12-24T22:06:35.257 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mon": "20/20", 2019-12-24T22:06:35.257 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_monc": "0/10", 2019-12-24T22:06:35.257 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_ms": "1/1", 2019-12-24T22:06:35.257 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_none": "0/5", 2019-12-24T22:06:35.257 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_objclass": "0/5", 2019-12-24T22:06:35.258 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_objectcacher": "0/5", 2019-12-24T22:06:35.258 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_objecter": "0/1", 2019-12-24T22:06:35.258 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_optracker": "0/5", 2019-12-24T22:06:35.258 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_osd": "1/5", 2019-12-24T22:06:35.258 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_paxos": "20/20", 2019-12-24T22:06:35.258 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_perfcounter": "1/5", 2019-12-24T22:06:35.259 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_prioritycache": "1/5", 2019-12-24T22:06:35.259 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rados": "0/5", 2019-12-24T22:06:35.259 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rbd": "0/5", 2019-12-24T22:06:35.259 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rbd_mirror": "0/5", 2019-12-24T22:06:35.259 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rbd_replay": "0/5", 2019-12-24T22:06:35.259 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_refs": "0/0", 2019-12-24T22:06:35.259 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_reserver": "1/1", 2019-12-24T22:06:35.260 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rgw": "1/5", 2019-12-24T22:06:35.260 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rgw_sync": "1/5", 2019-12-24T22:06:35.260 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rocksdb": "4/5", 2019-12-24T22:06:35.260 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_shell": "false", 2019-12-24T22:06:35.260 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_striper": "0/1", 2019-12-24T22:06:35.260 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_test": "0/5", 2019-12-24T22:06:35.260 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_throttle": "1/1", 2019-12-24T22:06:35.261 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_timer": "0/1", 2019-12-24T22:06:35.261 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_tp": "0/5", 2019-12-24T22:06:35.261 INFO:teuthology.orchestra.run.smithi037.stdout: "device_failure_prediction_mode": "none", 2019-12-24T22:06:35.261 INFO:teuthology.orchestra.run.smithi037.stdout: "echo": "false", 2019-12-24T22:06:35.261 INFO:teuthology.orchestra.run.smithi037.stdout: "editor": "vim", 2019-12-24T22:06:35.261 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2019-12-24T22:06:35.261 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2019-12-24T22:06:35.262 INFO:teuthology.orchestra.run.smithi037.stdout: "err_to_graylog": "false", 2019-12-24T22:06:35.262 INFO:teuthology.orchestra.run.smithi037.stdout: "err_to_stderr": "true", 2019-12-24T22:06:35.262 INFO:teuthology.orchestra.run.smithi037.stdout: "err_to_syslog": "false", 2019-12-24T22:06:35.262 INFO:teuthology.orchestra.run.smithi037.stdout: "event_tracing": "false", 2019-12-24T22:06:35.262 INFO:teuthology.orchestra.run.smithi037.stdout: "fake_statfs_for_testing": "0", 2019-12-24T22:06:35.262 INFO:teuthology.orchestra.run.smithi037.stdout: "fatal_signal_handlers": "true", 2019-12-24T22:06:35.262 INFO:teuthology.orchestra.run.smithi037.stdout: "feedback_to_output": "false", 2019-12-24T22:06:35.263 INFO:teuthology.orchestra.run.smithi037.stdout: "filer_max_purge_ops": "10", 2019-12-24T22:06:35.263 INFO:teuthology.orchestra.run.smithi037.stdout: "filer_max_truncate_ops": "128", 2019-12-24T22:06:35.263 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_apply_finisher_threads": "1", 2019-12-24T22:06:35.263 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_blackhole": "false", 2019-12-24T22:06:35.263 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_btrfs_clone_range": "true", 2019-12-24T22:06:35.263 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_btrfs_snap": "true", 2019-12-24T22:06:35.263 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_caller_concurrency": "10", 2019-12-24T22:06:35.264 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_collect_device_partition_information": "true", 2019-12-24T22:06:35.264 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_commit_timeout": "600.000000", 2019-12-24T22:06:35.264 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_debug_inject_read_err": "false", 2019-12-24T22:06:35.264 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_debug_omap_check": "false", 2019-12-24T22:06:35.264 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_debug_random_read_err": "0.000000", 2019-12-24T22:06:35.264 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_debug_verify_split": "false", 2019-12-24T22:06:35.264 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_dump_file": "", 2019-12-24T22:06:35.265 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2019-12-24T22:06:35.265 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_expected_throughput_ops": "200.000000", 2019-12-24T22:06:35.265 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fadvise": "true", 2019-12-24T22:06:35.265 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fail_eio": "true", 2019-12-24T22:06:35.265 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fd_cache_shards": "16", 2019-12-24T22:06:35.265 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fd_cache_size": "128", 2019-12-24T22:06:35.265 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fiemap": "false", 2019-12-24T22:06:35.266 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fiemap_threshold": "4096", 2019-12-24T22:06:35.266 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fsync_flushes_journal_data": "false", 2019-12-24T22:06:35.266 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_index_retry_probability": "0.000000", 2019-12-24T22:06:35.266 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_inject_stall": "0", 2019-12-24T22:06:35.266 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_journal_parallel": "false", 2019-12-24T22:06:35.266 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_journal_trailing": "false", 2019-12-24T22:06:35.266 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_journal_writeahead": "false", 2019-12-24T22:06:35.266 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_kill_at": "0", 2019-12-24T22:06:35.267 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_alloc_hint_size": "1048576", 2019-12-24T22:06:35.267 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattr_size": "0", 2019-12-24T22:06:35.267 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2019-12-24T22:06:35.267 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattr_size_other": "512", 2019-12-24T22:06:35.267 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2019-12-24T22:06:35.267 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattrs": "0", 2019-12-24T22:06:35.267 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2019-12-24T22:06:35.268 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattrs_other": "2", 2019-12-24T22:06:35.268 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattrs_xfs": "10", 2019-12-24T22:06:35.268 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_sync_interval": "5.000000", 2019-12-24T22:06:35.268 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_xattr_value_size": "0", 2019-12-24T22:06:35.268 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2019-12-24T22:06:35.268 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_xattr_value_size_other": "1024", 2019-12-24T22:06:35.269 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2019-12-24T22:06:35.269 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_merge_threshold": "-10", 2019-12-24T22:06:35.269 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_min_sync_interval": "0.010000", 2019-12-24T22:06:35.269 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_odsync_write": "false", 2019-12-24T22:06:35.269 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_omap_backend": "rocksdb", 2019-12-24T22:06:35.269 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_omap_backend_path": "", 2019-12-24T22:06:35.269 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_omap_header_cache_size": "1024", 2019-12-24T22:06:35.270 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_ondisk_finisher_threads": "1", 2019-12-24T22:06:35.270 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_op_thread_suicide_timeout": "180", 2019-12-24T22:06:35.270 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_op_thread_timeout": "60", 2019-12-24T22:06:35.270 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_op_threads": "2", 2019-12-24T22:06:35.270 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_punch_hole": "false", 2019-12-24T22:06:35.270 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2019-12-24T22:06:35.270 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2019-12-24T22:06:35.270 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2019-12-24T22:06:35.271 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_high_threshhold": "0.900000", 2019-12-24T22:06:35.271 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_low_threshhold": "0.300000", 2019-12-24T22:06:35.271 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_max_bytes": "104857600", 2019-12-24T22:06:35.271 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2019-12-24T22:06:35.271 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2019-12-24T22:06:35.271 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2019-12-24T22:06:35.271 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_max_ops": "50", 2019-12-24T22:06:35.272 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2019-12-24T22:06:35.272 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_seek_data_hole": "false", 2019-12-24T22:06:35.272 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_sloppy_crc": "false", 2019-12-24T22:06:35.272 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_sloppy_crc_block_size": "65536", 2019-12-24T22:06:35.272 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_splice": "false", 2019-12-24T22:06:35.272 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_split_multiple": "2", 2019-12-24T22:06:35.273 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_split_rand_factor": "20", 2019-12-24T22:06:35.273 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_update_to": "1000", 2019-12-24T22:06:35.273 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2019-12-24T22:06:35.273 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2019-12-24T22:06:35.273 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2019-12-24T22:06:35.273 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2019-12-24T22:06:35.273 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2019-12-24T22:06:35.274 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2019-12-24T22:06:35.274 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_enable": "true", 2019-12-24T22:06:35.274 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2019-12-24T22:06:35.274 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2019-12-24T22:06:35.274 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2019-12-24T22:06:35.274 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2019-12-24T22:06:35.274 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2019-12-24T22:06:35.274 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2019-12-24T22:06:35.275 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_xfs_extsize": "false", 2019-12-24T22:06:35.275 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_zfs_snap": "false", 2019-12-24T22:06:35.275 INFO:teuthology.orchestra.run.smithi037.stdout: "fio_dir": "/tmp/fio", 2019-12-24T22:06:35.275 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "4a02c23c-2698-11ea-8286-001a4aab830c", 2019-12-24T22:06:35.275 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_allow_other": "true", 2019-12-24T22:06:35.275 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_atomic_o_trunc": "true", 2019-12-24T22:06:35.275 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_big_writes": "false", 2019-12-24T22:06:35.276 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_debug": "false", 2019-12-24T22:06:35.276 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_default_permissions": "false", 2019-12-24T22:06:35.276 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_disable_pagecache": "false", 2019-12-24T22:06:35.276 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_max_write": "0", 2019-12-24T22:06:35.276 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_multithreaded": "true", 2019-12-24T22:06:35.276 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_require_active_mds": "true", 2019-12-24T22:06:35.276 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_set_user_groups": "true", 2019-12-24T22:06:35.277 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_syncfs_on_mksnap": "true", 2019-12-24T22:06:35.277 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_use_invalidate_cb": "true", 2019-12-24T22:06:35.277 INFO:teuthology.orchestra.run.smithi037.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2019-12-24T22:06:35.277 INFO:teuthology.orchestra.run.smithi037.stdout: "gss_target_name": "ceph", 2019-12-24T22:06:35.277 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_file": "", 2019-12-24T22:06:35.277 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_inject_failure": "0", 2019-12-24T22:06:35.278 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_interval": "5", 2019-12-24T22:06:35.278 INFO:teuthology.orchestra.run.smithi037.stdout: "host": "", 2019-12-24T22:06:35.278 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2019-12-24T22:06:35.278 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_max_inflight_ops": "128", 2019-12-24T22:06:35.278 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_max_size": "1073741824", 2019-12-24T22:06:35.278 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_path": "/tmp", 2019-12-24T22:06:35.278 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2019-12-24T22:06:35.279 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_watermark": "0.100000", 2019-12-24T22:06:35.279 INFO:teuthology.orchestra.run.smithi037.stdout: "inject_early_sigterm": "false", 2019-12-24T22:06:35.279 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_aio": "true", 2019-12-24T22:06:35.279 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_align_min_size": "65536", 2019-12-24T22:06:35.279 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_block_align": "true", 2019-12-24T22:06:35.279 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_block_size": "4096", 2019-12-24T22:06:35.279 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_dio": "true", 2019-12-24T22:06:35.280 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_discard": "false", 2019-12-24T22:06:35.280 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_force_aio": "false", 2019-12-24T22:06:35.280 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_ignore_corruption": "false", 2019-12-24T22:06:35.280 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_max_write_bytes": "10485760", 2019-12-24T22:06:35.280 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_max_write_entries": "100", 2019-12-24T22:06:35.280 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_replay_from": "0", 2019-12-24T22:06:35.280 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_throttle_high_multiple": "0.000000", 2019-12-24T22:06:35.281 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_throttle_high_threshhold": "0.900000", 2019-12-24T22:06:35.281 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_throttle_low_threshhold": "0.600000", 2019-12-24T22:06:35.281 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_throttle_max_multiple": "0.000000", 2019-12-24T22:06:35.281 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_write_header_frequency": "0", 2019-12-24T22:06:35.281 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_zero_on_create": "false", 2019-12-24T22:06:35.281 INFO:teuthology.orchestra.run.smithi037.stdout: "journaler_prefetch_periods": "10", 2019-12-24T22:06:35.281 INFO:teuthology.orchestra.run.smithi037.stdout: "journaler_prezero_periods": "5", 2019-12-24T22:06:35.282 INFO:teuthology.orchestra.run.smithi037.stdout: "journaler_write_head_interval": "15", 2019-12-24T22:06:35.282 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "", 2019-12-24T22:06:35.282 INFO:teuthology.orchestra.run.smithi037.stdout: "keyfile": "", 2019-12-24T22:06:35.282 INFO:teuthology.orchestra.run.smithi037.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2019-12-24T22:06:35.282 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_backend": "rocksdb", 2019-12-24T22:06:35.282 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_default_stripe_size": "65536", 2019-12-24T22:06:35.282 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_fsck_on_mount": "false", 2019-12-24T22:06:35.282 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_fsck_on_mount_deep": "true", 2019-12-24T22:06:35.283 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_max_bytes": "67108864", 2019-12-24T22:06:35.283 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_max_ops": "512", 2019-12-24T22:06:35.283 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_nid_prealloc": "1024", 2019-12-24T22:06:35.283 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_onode_map_size": "1024", 2019-12-24T22:06:35.283 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2019-12-24T22:06:35.283 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_sync_submit_transaction": "false", 2019-12-24T22:06:35.283 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_sync_transaction": "false", 2019-12-24T22:06:35.284 INFO:teuthology.orchestra.run.smithi037.stdout: "leveldb_block_size": "65536", 2019-12-24T22:06:35.284 INFO:teuthology.orchestra.run.smithi037.stdout: "leveldb_bloom_size": "0", 2019-12-24T22:06:35.284 INFO:teuthology.orchestra.run.smithi037.stdout: "leveldb_cache_size": "536870912", 2019-12-24T22:06:35.284 INFO:teuthology.orchestra.run.smithi037.stdout: "leveldb_compact_on_mount": "false", 2019-12-24T22:06:35.284 INFO:teuthology.orchestra.run.smithi037.stdout: "leveldb_compression": "false", 2019-12-24T22:06:35.284 INFO:teuthology.orchestra.run.smithi037.stdout: "leveldb_log": "", 2019-12-24T22:06:35.284 INFO:teuthology.orchestra.run.smithi037.stdout: "leveldb_log_to_ceph_log": "true", 2019-12-24T22:06:35.285 INFO:teuthology.orchestra.run.smithi037.stdout: "leveldb_max_open_files": "0", 2019-12-24T22:06:35.285 INFO:teuthology.orchestra.run.smithi037.stdout: "leveldb_paranoid": "false", 2019-12-24T22:06:35.285 INFO:teuthology.orchestra.run.smithi037.stdout: "leveldb_write_buffer_size": "33554432", 2019-12-24T22:06:35.285 INFO:teuthology.orchestra.run.smithi037.stdout: "lockdep": "false", 2019-12-24T22:06:35.285 INFO:teuthology.orchestra.run.smithi037.stdout: "lockdep_force_backtrace": "false", 2019-12-24T22:06:35.285 INFO:teuthology.orchestra.run.smithi037.stdout: "log_coarse_timestamps": "true", 2019-12-24T22:06:35.285 INFO:teuthology.orchestra.run.smithi037.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2019-12-24T22:06:35.286 INFO:teuthology.orchestra.run.smithi037.stdout: "log_flush_on_exit": "false", 2019-12-24T22:06:35.286 INFO:teuthology.orchestra.run.smithi037.stdout: "log_graylog_host": "127.0.0.1", 2019-12-24T22:06:35.286 INFO:teuthology.orchestra.run.smithi037.stdout: "log_graylog_port": "12201", 2019-12-24T22:06:35.286 INFO:teuthology.orchestra.run.smithi037.stdout: "log_max_new": "1000", 2019-12-24T22:06:35.286 INFO:teuthology.orchestra.run.smithi037.stdout: "log_max_recent": "10000", 2019-12-24T22:06:35.286 INFO:teuthology.orchestra.run.smithi037.stdout: "log_stderr_prefix": "", 2019-12-24T22:06:35.286 INFO:teuthology.orchestra.run.smithi037.stdout: "log_stop_at_utilization": "0.970000", 2019-12-24T22:06:35.287 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": "true", 2019-12-24T22:06:35.287 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_graylog": "false", 2019-12-24T22:06:35.287 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_stderr": "false", 2019-12-24T22:06:35.287 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_syslog": "false", 2019-12-24T22:06:35.287 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completion_items": "50", 2019-12-24T22:06:35.287 INFO:teuthology.orchestra.run.smithi037.stdout: "max_rotating_auth_attempts": "10", 2019-12-24T22:06:35.287 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_action_on_write_error": "1", 2019-12-24T22:06:35.287 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_export_pin": "true", 2019-12-24T22:06:35.288 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_fragment_dirs": "true", 2019-12-24T22:06:35.288 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2019-12-24T22:06:35.288 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_fragment_interval": "5", 2019-12-24T22:06:35.288 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_fragment_size_max": "100000", 2019-12-24T22:06:35.288 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_idle_threshold": "0.000000", 2019-12-24T22:06:35.288 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_interval": "10", 2019-12-24T22:06:35.288 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_max": "-1", 2019-12-24T22:06:35.289 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_max_until": "-1", 2019-12-24T22:06:35.289 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_merge_size": "50", 2019-12-24T22:06:35.289 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_midchunk": "0.300000", 2019-12-24T22:06:35.289 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_min_rebalance": "0.100000", 2019-12-24T22:06:35.289 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_min_start": "0.200000", 2019-12-24T22:06:35.289 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_minchunk": "0.001000", 2019-12-24T22:06:35.289 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_mode": "0", 2019-12-24T22:06:35.290 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_need_max": "1.200000", 2019-12-24T22:06:35.290 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_need_min": "0.800000", 2019-12-24T22:06:35.290 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_replicate_threshold": "8000.000000", 2019-12-24T22:06:35.290 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_sample_interval": "3.000000", 2019-12-24T22:06:35.290 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_split_bits": "3", 2019-12-24T22:06:35.290 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_split_rd": "25000.000000", 2019-12-24T22:06:35.290 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_split_size": "10000", 2019-12-24T22:06:35.291 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_split_wr": "10000.000000", 2019-12-24T22:06:35.291 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_target_decay": "10.000000", 2019-12-24T22:06:35.291 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2019-12-24T22:06:35.291 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_beacon_grace": "15.000000", 2019-12-24T22:06:35.291 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_beacon_interval": "4.000000", 2019-12-24T22:06:35.291 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_memory_limit": "4294967296", 2019-12-24T22:06:35.291 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_mid": "0.700000", 2019-12-24T22:06:35.291 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_release_free_interval": "10", 2019-12-24T22:06:35.292 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_reservation": "0.050000", 2019-12-24T22:06:35.292 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_trim_decay_rate": "1.000000", 2019-12-24T22:06:35.292 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_trim_interval": "1", 2019-12-24T22:06:35.292 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_trim_threshold": "65536", 2019-12-24T22:06:35.292 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2019-12-24T22:06:35.292 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_client_prealloc_inos": "1000", 2019-12-24T22:06:35.292 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2019-12-24T22:06:35.293 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_damage_table_max_entries": "10000", 2019-12-24T22:06:35.293 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2019-12-24T22:06:35.293 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_debug_auth_pins": "false", 2019-12-24T22:06:35.293 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_debug_frag": "false", 2019-12-24T22:06:35.293 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_debug_scatterstat": "false", 2019-12-24T22:06:35.293 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_debug_subtrees": "false", 2019-12-24T22:06:35.293 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_decay_halflife": "5.000000", 2019-12-24T22:06:35.294 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_default_dir_hash": "2", 2019-12-24T22:06:35.294 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_defer_session_stale": "true", 2019-12-24T22:06:35.294 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dir_keys_per_op": "16384", 2019-12-24T22:06:35.294 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dir_max_commit_size": "10", 2019-12-24T22:06:35.294 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dirstat_min_interval": "1.000000", 2019-12-24T22:06:35.294 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dump_cache_after_rejoin": "false", 2019-12-24T22:06:35.294 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dump_cache_on_map": "false", 2019-12-24T22:06:35.294 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dump_cache_threshold_file": "0", 2019-12-24T22:06:35.295 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2019-12-24T22:06:35.295 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_early_reply": "true", 2019-12-24T22:06:35.295 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_enable_op_tracker": "true", 2019-12-24T22:06:35.295 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_enforce_unique_name": "true", 2019-12-24T22:06:35.295 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_freeze_tree_timeout": "30.000000", 2019-12-24T22:06:35.295 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2019-12-24T22:06:35.295 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_health_cache_threshold": "1.500000", 2019-12-24T22:06:35.296 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_health_summarize_threshold": "10", 2019-12-24T22:06:35.296 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_heartbeat_grace": "15.000000", 2019-12-24T22:06:35.296 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_inject_migrator_session_race": "false", 2019-12-24T22:06:35.296 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2019-12-24T22:06:35.296 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_journal_format": "1", 2019-12-24T22:06:35.296 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_create_at": "0", 2019-12-24T22:06:35.296 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_export_at": "0", 2019-12-24T22:06:35.297 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_import_at": "0", 2019-12-24T22:06:35.297 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_journal_at": "0", 2019-12-24T22:06:35.297 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_journal_expire_at": "0", 2019-12-24T22:06:35.297 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_journal_replay_at": "0", 2019-12-24T22:06:35.297 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_link_at": "0", 2019-12-24T22:06:35.297 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_mdstable_at": "0", 2019-12-24T22:06:35.297 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_openc_at": "0", 2019-12-24T22:06:35.298 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_rename_at": "0", 2019-12-24T22:06:35.298 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_events_per_segment": "1024", 2019-12-24T22:06:35.298 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_max_events": "-1", 2019-12-24T22:06:35.299 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_max_segments": "128", 2019-12-24T22:06:35.299 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_pause": "false", 2019-12-24T22:06:35.299 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_segment_size": "0", 2019-12-24T22:06:35.299 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_skip_corrupt_events": "false", 2019-12-24T22:06:35.299 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_caps_per_client": "1048576", 2019-12-24T22:06:35.299 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_completed_flushes": "100000", 2019-12-24T22:06:35.299 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_completed_requests": "100000", 2019-12-24T22:06:35.300 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_export_size": "20971520", 2019-12-24T22:06:35.300 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_file_recover": "32", 2019-12-24T22:06:35.300 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_purge_files": "64", 2019-12-24T22:06:35.300 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_purge_ops": "8192", 2019-12-24T22:06:35.300 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2019-12-24T22:06:35.300 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_retries_on_remount_failure": "5", 2019-12-24T22:06:35.300 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_scrub_ops_in_progress": "5", 2019-12-24T22:06:35.301 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_snaps_per_dir": "100", 2019-12-24T22:06:35.301 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_xattr_pairs_size": "65536", 2019-12-24T22:06:35.301 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_min_caps_per_client": "100", 2019-12-24T22:06:35.301 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_mon_shutdown_timeout": "5.000000", 2019-12-24T22:06:35.301 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_numa_node": "-1", 2019-12-24T22:06:35.301 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_op_complaint_time": "30.000000", 2019-12-24T22:06:35.301 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_op_history_duration": "600", 2019-12-24T22:06:35.302 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_op_history_size": "20", 2019-12-24T22:06:35.302 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_op_log_threshold": "5", 2019-12-24T22:06:35.302 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2019-12-24T22:06:35.302 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_recall_global_max_decay_threshold": "65536", 2019-12-24T22:06:35.302 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_recall_max_caps": "5000", 2019-12-24T22:06:35.302 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_recall_max_decay_rate": "2.500000", 2019-12-24T22:06:35.303 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_recall_max_decay_threshold": "16384", 2019-12-24T22:06:35.303 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_recall_warning_decay_rate": "60.000000", 2019-12-24T22:06:35.303 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_recall_warning_threshold": "32768", 2019-12-24T22:06:35.303 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_reconnect_timeout": "45.000000", 2019-12-24T22:06:35.303 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_replay_interval": "1.000000", 2019-12-24T22:06:35.303 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_replay_unsafe_with_closed_session": "false", 2019-12-24T22:06:35.303 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_request_load_average_decay_rate": "60.000000", 2019-12-24T22:06:35.304 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_root_ino_gid": "0", 2019-12-24T22:06:35.304 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_root_ino_uid": "0", 2019-12-24T22:06:35.304 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_scatter_nudge_interval": "5.000000", 2019-12-24T22:06:35.304 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_session_blacklist_on_evict": "true", 2019-12-24T22:06:35.304 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_session_blacklist_on_timeout": "true", 2019-12-24T22:06:35.304 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2019-12-24T22:06:35.304 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_session_cache_liveness_magnitude": "10", 2019-12-24T22:06:35.305 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_sessionmap_keys_per_op": "1024", 2019-12-24T22:06:35.305 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_shutdown_check": "0", 2019-12-24T22:06:35.305 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_skip_ino": "0", 2019-12-24T22:06:35.305 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_snap_max_uid": "4294967294", 2019-12-24T22:06:35.305 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_snap_min_uid": "0", 2019-12-24T22:06:35.305 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_snap_rstat": "false", 2019-12-24T22:06:35.305 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_task_status_update_interval": "2.000000", 2019-12-24T22:06:35.306 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_thrash_exports": "0", 2019-12-24T22:06:35.306 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_thrash_fragments": "0", 2019-12-24T22:06:35.306 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_tick_interval": "5.000000", 2019-12-24T22:06:35.306 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_verify_backtrace": "1", 2019-12-24T22:06:35.306 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_verify_scatter": "false", 2019-12-24T22:06:35.306 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_wipe_ino_prealloc": "false", 2019-12-24T22:06:35.306 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_wipe_sessions": "false", 2019-12-24T22:06:35.307 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool_debug": "false", 2019-12-24T22:06:35.307 INFO:teuthology.orchestra.run.smithi037.stdout: "memstore_debug_omit_block_device_write": "false", 2019-12-24T22:06:35.307 INFO:teuthology.orchestra.run.smithi037.stdout: "memstore_device_bytes": "1073741824", 2019-12-24T22:06:35.307 INFO:teuthology.orchestra.run.smithi037.stdout: "memstore_page_set": "false", 2019-12-24T22:06:35.307 INFO:teuthology.orchestra.run.smithi037.stdout: "memstore_page_size": "65536", 2019-12-24T22:06:35.307 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_client_bytes": "134217728", 2019-12-24T22:06:35.307 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_client_messages": "512", 2019-12-24T22:06:35.307 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2019-12-24T22:06:35.308 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_connect_retry_interval": "1.000000", 2019-12-24T22:06:35.308 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2019-12-24T22:06:35.308 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2019-12-24T22:06:35.308 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_initial_modules": "restful iostat", 2019-12-24T22:06:35.308 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_mds_bytes": "134217728", 2019-12-24T22:06:35.308 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_mds_messages": "128", 2019-12-24T22:06:35.308 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2019-12-24T22:06:35.309 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_mon_bytes": "134217728", 2019-12-24T22:06:35.309 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_mon_messages": "128", 2019-12-24T22:06:35.309 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_osd_bytes": "536870912", 2019-12-24T22:06:35.309 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_osd_messages": "8192", 2019-12-24T22:06:35.309 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_service_beacon_grace": "60.000000", 2019-12-24T22:06:35.309 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_stats_period": "5", 2019-12-24T22:06:35.309 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_stats_threshold": "5", 2019-12-24T22:06:35.310 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_tick_period": "2", 2019-12-24T22:06:35.310 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_accept_timeout_factor": "2.000000", 2019-12-24T22:06:35.310 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_allow_pool_delete": "true", 2019-12-24T22:06:35.310 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2019-12-24T22:06:35.310 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2019-12-24T22:06:35.310 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_bytes": "104857600", 2019-12-24T22:06:35.310 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_directed_command_retry": "5", 2019-12-24T22:06:35.311 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_hunt_interval": "3.000000", 2019-12-24T22:06:35.311 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2019-12-24T22:06:35.311 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2019-12-24T22:06:35.311 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2019-12-24T22:06:35.311 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_hunt_parallel": "3", 2019-12-24T22:06:35.311 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_max_log_entries_per_message": "1000", 2019-12-24T22:06:35.311 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_ping_interval": "10.000000", 2019-12-24T22:06:35.311 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_ping_timeout": "30.000000", 2019-12-24T22:06:35.312 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_clock_drift_allowed": "1.000000", 2019-12-24T22:06:35.312 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2019-12-24T22:06:35.312 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2019-12-24T22:06:35.312 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_file_level": "debug", 2019-12-24T22:06:35.312 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_file": "true", 2019-12-24T22:06:35.312 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_graylog": "false", 2019-12-24T22:06:35.312 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2019-12-24T22:06:35.313 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_graylog_port": "12201", 2019-12-24T22:06:35.313 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_stderr": "false", 2019-12-24T22:06:35.313 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_syslog": "default=false", 2019-12-24T22:06:35.313 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2019-12-24T22:06:35.313 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_syslog_level": "info", 2019-12-24T22:06:35.313 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_compact_on_bootstrap": "false", 2019-12-24T22:06:35.313 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_compact_on_start": "false", 2019-12-24T22:06:35.314 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_compact_on_trim": "true", 2019-12-24T22:06:35.314 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_config_key_max_entry_size": "65536", 2019-12-24T22:06:35.314 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cpu_threads": "4", 2019-12-24T22:06:35.314 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_crush_min_required_version": "hammer", 2019-12-24T22:06:35.314 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_daemon_bytes": "419430400", 2019-12-24T22:06:35.314 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2019-12-24T22:06:35.314 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_data_avail_crit": "5", 2019-12-24T22:06:35.315 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_data_avail_warn": "5", 2019-12-24T22:06:35.315 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_data_size_warn": "16106127360", 2019-12-24T22:06:35.315 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_block_osdmap_trim": "false", 2019-12-24T22:06:35.315 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_deprecated_as_obsolete": "false", 2019-12-24T22:06:35.315 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_dump_json": "false", 2019-12-24T22:06:35.315 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2019-12-24T22:06:35.315 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_dump_transactions": "false", 2019-12-24T22:06:35.316 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_extra_checks": "false", 2019-12-24T22:06:35.316 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_no_initial_persistent_features": "false", 2019-12-24T22:06:35.316 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2019-12-24T22:06:35.316 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_no_require_nautilus": "false", 2019-12-24T22:06:35.316 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_no_require_octopus": "false", 2019-12-24T22:06:35.316 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2019-12-24T22:06:35.316 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_delta_reset_interval": "10.000000", 2019-12-24T22:06:35.317 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_dns_srv_name": "ceph-mon", 2019-12-24T22:06:35.317 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_election_timeout": "5.000000", 2019-12-24T22:06:35.317 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_enable_op_tracker": "true", 2019-12-24T22:06:35.317 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_fake_pool_delete": "false", 2019-12-24T22:06:35.317 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_force_quorum_join": "false", 2019-12-24T22:06:35.317 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_globalid_prealloc": "10000", 2019-12-24T22:06:35.317 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_health_log_update_period": "5", 2019-12-24T22:06:35.318 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_health_max_detail": "50", 2019-12-24T22:06:35.318 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_health_to_clog": "true", 2019-12-24T22:06:35.318 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_health_to_clog_interval": "3600", 2019-12-24T22:06:35.318 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2019-12-24T22:06:35.318 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_host": "[v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0]", 2019-12-24T22:06:35.318 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_initial_members": "", 2019-12-24T22:06:35.318 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2019-12-24T22:06:35.318 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2019-12-24T22:06:35.319 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_inject_transaction_delay_max": "10.000000", 2019-12-24T22:06:35.319 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2019-12-24T22:06:35.319 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_keyvaluedb": "rocksdb", 2019-12-24T22:06:35.319 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_lease": "5.000000", 2019-12-24T22:06:35.319 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2019-12-24T22:06:35.319 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_lease_renew_interval_factor": "0.600000", 2019-12-24T22:06:35.319 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_log_max_summary": "50", 2019-12-24T22:06:35.320 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_log_entries_per_event": "4096", 2019-12-24T22:06:35.320 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_log_epochs": "500", 2019-12-24T22:06:35.320 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_mdsmap_epochs": "500", 2019-12-24T22:06:35.320 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_mgrmap_epochs": "500", 2019-12-24T22:06:35.320 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_osd": "10000", 2019-12-24T22:06:35.320 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_pg_per_osd": "10000", 2019-12-24T22:06:35.320 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_pool_pg_num": "65536", 2019-12-24T22:06:35.321 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_snap_prune_per_epoch": "100", 2019-12-24T22:06:35.321 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mds_blacklist_interval": "86400.000000", 2019-12-24T22:06:35.321 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mds_force_trim_to": "0", 2019-12-24T22:06:35.321 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mds_skip_sanity": "false", 2019-12-24T22:06:35.321 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_memory_autotune": "true", 2019-12-24T22:06:35.321 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_memory_target": "2147483648", 2019-12-24T22:06:35.321 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mgr_beacon_grace": "30", 2019-12-24T22:06:35.322 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mgr_blacklist_interval": "86400.000000", 2019-12-24T22:06:35.322 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mgr_digest_period": "5", 2019-12-24T22:06:35.322 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mgr_inactive_grace": "60", 2019-12-24T22:06:35.322 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mgr_mkfs_grace": "240", 2019-12-24T22:06:35.322 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2019-12-24T22:06:35.322 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_min_osdmap_epochs": "50", 2019-12-24T22:06:35.323 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_op_complaint_time": "30", 2019-12-24T22:06:35.323 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_op_history_duration": "600", 2019-12-24T22:06:35.323 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_op_history_size": "20", 2019-12-24T22:06:35.323 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_op_history_slow_op_size": "20", 2019-12-24T22:06:35.323 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_op_history_slow_op_threshold": "10", 2019-12-24T22:06:35.323 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_op_log_threshold": "5", 2019-12-24T22:06:35.323 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_adjust_down_out_interval": "true", 2019-12-24T22:06:35.324 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2019-12-24T22:06:35.324 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2019-12-24T22:06:35.324 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_auto_mark_in": "false", 2019-12-24T22:06:35.324 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_auto_mark_new_in": "true", 2019-12-24T22:06:35.324 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2019-12-24T22:06:35.324 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_blacklist_default_expire": "3600.000000", 2019-12-24T22:06:35.324 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_cache_size": "500", 2019-12-24T22:06:35.325 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_cache_size_min": "134217728", 2019-12-24T22:06:35.325 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_crush_smoke_test": "true", 2019-12-24T22:06:35.325 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_destroyed_out_interval": "600", 2019-12-24T22:06:35.325 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_down_out_interval": "600", 2019-12-24T22:06:35.325 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_down_out_subtree_limit": "rack", 2019-12-24T22:06:35.325 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2019-12-24T22:06:35.325 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_force_trim_to": "0", 2019-12-24T22:06:35.326 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_full_ratio": "0.950000", 2019-12-24T22:06:35.326 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_initial_require_min_compat_client": "jewel", 2019-12-24T22:06:35.326 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_laggy_halflife": "3600", 2019-12-24T22:06:35.326 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_laggy_max_interval": "300", 2019-12-24T22:06:35.326 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_laggy_weight": "0.300000", 2019-12-24T22:06:35.326 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2019-12-24T22:06:35.326 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_max_creating_pgs": "1024", 2019-12-24T22:06:35.327 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_max_initial_pgs": "1024", 2019-12-24T22:06:35.327 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_min_down_reporters": "2", 2019-12-24T22:06:35.327 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_min_in_ratio": "0.750000", 2019-12-24T22:06:35.327 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_min_up_ratio": "0.300000", 2019-12-24T22:06:35.327 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_nearfull_ratio": "0.850000", 2019-12-24T22:06:35.327 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_prime_pg_temp": "true", 2019-12-24T22:06:35.327 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2019-12-24T22:06:35.328 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2019-12-24T22:06:35.328 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_report_timeout": "900", 2019-12-24T22:06:35.328 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_reporter_subtree_level": "osd", 2019-12-24T22:06:35.328 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2019-12-24T22:06:35.329 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_warn_op_age": "32.000000", 2019-12-24T22:06:35.329 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osdmap_full_prune_enabled": "true", 2019-12-24T22:06:35.329 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osdmap_full_prune_interval": "2", 2019-12-24T22:06:35.329 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osdmap_full_prune_min": "15", 2019-12-24T22:06:35.329 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osdmap_full_prune_txsize": "2", 2019-12-24T22:06:35.329 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2019-12-24T22:06:35.330 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pg_stuck_threshold": "60", 2019-12-24T22:06:35.330 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2019-12-24T22:06:35.330 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pg_warn_min_objects": "10000", 2019-12-24T22:06:35.330 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pg_warn_min_per_osd": "0", 2019-12-24T22:06:35.330 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pg_warn_min_pool_objects": "1000", 2019-12-24T22:06:35.330 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pool_quota_crit_threshold": "0", 2019-12-24T22:06:35.330 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pool_quota_warn_threshold": "0", 2019-12-24T22:06:35.331 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_probe_timeout": "2.000000", 2019-12-24T22:06:35.331 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_reweight_max_change": "0.050000", 2019-12-24T22:06:35.331 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_reweight_max_osds": "4", 2019-12-24T22:06:35.331 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_reweight_min_bytes_per_osd": "10", 2019-12-24T22:06:35.331 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_reweight_min_pgs_per_osd": "4", 2019-12-24T22:06:35.331 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2019-12-24T22:06:35.332 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2019-12-24T22:06:35.332 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2019-12-24T22:06:35.332 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_scrub_interval": "86400", 2019-12-24T22:06:35.332 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_scrub_max_keys": "100", 2019-12-24T22:06:35.332 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_scrub_timeout": "300", 2019-12-24T22:06:35.332 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_session_timeout": "300", 2019-12-24T22:06:35.332 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_smart_report_timeout": "5", 2019-12-24T22:06:35.333 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_stat_smooth_intervals": "6", 2019-12-24T22:06:35.333 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_subscribe_interval": "86400.000000", 2019-12-24T22:06:35.333 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_sync_debug": "false", 2019-12-24T22:06:35.333 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_sync_max_payload_keys": "2000", 2019-12-24T22:06:35.333 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_sync_max_payload_size": "1048576", 2019-12-24T22:06:35.333 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_sync_provider_kill_at": "0", 2019-12-24T22:06:35.333 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_sync_requester_kill_at": "0", 2019-12-24T22:06:35.334 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_sync_timeout": "60.000000", 2019-12-24T22:06:35.334 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_target_pg_per_osd": "100", 2019-12-24T22:06:35.334 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_tick_interval": "5", 2019-12-24T22:06:35.334 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_timecheck_interval": "300.000000", 2019-12-24T22:06:35.334 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_timecheck_skew_interval": "30.000000", 2019-12-24T22:06:35.334 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2019-12-24T22:06:35.334 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2019-12-24T22:06:35.335 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2019-12-24T22:06:35.335 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_misplaced": "false", 2019-12-24T22:06:35.335 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2019-12-24T22:06:35.335 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2019-12-24T22:06:35.335 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_pool_no_app": "true", 2019-12-24T22:06:35.335 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_pool_no_redundancy": "true", 2019-12-24T22:06:35.335 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2019-12-24T22:06:35.335 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2019-12-24T22:06:35.336 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2019-12-24T22:06:35.336 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_too_few_osds": "false", 2019-12-24T22:06:35.336 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2019-12-24T22:06:35.336 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2019-12-24T22:06:35.336 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": "", 2019-12-24T22:06:35.337 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_max_op_threads": "5", 2019-12-24T22:06:35.337 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_op_threads": "3", 2019-12-24T22:06:35.337 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_buffer_size": "131072", 2019-12-24T22:06:35.337 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_cm": "false", 2019-12-24T22:06:35.337 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_device_name": "", 2019-12-24T22:06:35.337 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_dscp": "96", 2019-12-24T22:06:35.337 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_enable_hugepage": "false", 2019-12-24T22:06:35.338 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_gid_idx": "0", 2019-12-24T22:06:35.338 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_local_gid": "", 2019-12-24T22:06:35.338 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_polling_us": "1000", 2019-12-24T22:06:35.338 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_port_num": "1", 2019-12-24T22:06:35.338 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_receive_buffers": "32768", 2019-12-24T22:06:35.338 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_receive_queue_len": "4096", 2019-12-24T22:06:35.339 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_roce_ver": "1", 2019-12-24T22:06:35.339 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_send_buffers": "1024", 2019-12-24T22:06:35.339 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_sl": "3", 2019-12-24T22:06:35.339 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_support_srq": "true", 2019-12-24T22:06:35.339 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_type": "ib", 2019-12-24T22:06:35.339 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_before_connect": "false", 2019-12-24T22:06:35.339 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_ipv4": "true", 2019-12-24T22:06:35.340 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_ipv6": "false", 2019-12-24T22:06:35.340 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_msgr1": "true", 2019-12-24T22:06:35.340 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_msgr2": "true", 2019-12-24T22:06:35.340 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_port_max": "7300", 2019-12-24T22:06:35.340 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_port_min": "6800", 2019-12-24T22:06:35.340 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_prefer_ipv4": "false", 2019-12-24T22:06:35.340 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_retry_count": "3", 2019-12-24T22:06:35.341 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_retry_delay": "5", 2019-12-24T22:06:35.341 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_blackhole_client": "false", 2019-12-24T22:06:35.341 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_blackhole_mds": "false", 2019-12-24T22:06:35.341 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_blackhole_mgr": "false", 2019-12-24T22:06:35.341 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_blackhole_mon": "false", 2019-12-24T22:06:35.341 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_blackhole_osd": "false", 2019-12-24T22:06:35.341 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_client_mode": "crc secure", 2019-12-24T22:06:35.342 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_cluster_mode": "crc secure", 2019-12-24T22:06:35.342 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_cluster_type": "", 2019-12-24T22:06:35.342 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_connection_idle_timeout": "900", 2019-12-24T22:06:35.342 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_connection_ready_timeout": "10", 2019-12-24T22:06:35.342 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_crc_data": "true", 2019-12-24T22:06:35.342 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_crc_header": "true", 2019-12-24T22:06:35.342 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_die_on_bad_msg": "false", 2019-12-24T22:06:35.343 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_die_on_bug": "true", 2019-12-24T22:06:35.343 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_die_on_old_message": "true", 2019-12-24T22:06:35.343 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_die_on_skipped_message": "false", 2019-12-24T22:06:35.343 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_die_on_unhandled_msg": "false", 2019-12-24T22:06:35.343 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dispatch_throttle_bytes": "104857600", 2019-12-24T22:06:35.343 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_coremask": "0xF", 2019-12-24T22:06:35.343 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_debug_allow_loopback": "false", 2019-12-24T22:06:35.344 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2019-12-24T22:06:35.344 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_host_ipv4_addr": "", 2019-12-24T22:06:35.344 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_hugepages": "", 2019-12-24T22:06:35.344 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_hw_flow_control": "true", 2019-12-24T22:06:35.344 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2019-12-24T22:06:35.345 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_lro": "true", 2019-12-24T22:06:35.345 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_memory_channel": "4", 2019-12-24T22:06:35.345 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2019-12-24T22:06:35.345 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_pmd": "", 2019-12-24T22:06:35.345 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_port_id": "0", 2019-12-24T22:06:35.345 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2019-12-24T22:06:35.345 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dump_corrupt_message_level": "1", 2019-12-24T22:06:35.346 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dump_on_send": "false", 2019-12-24T22:06:35.346 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_initial_backoff": "0.200000", 2019-12-24T22:06:35.346 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_inject_delay_max": "1.000000", 2019-12-24T22:06:35.346 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_inject_delay_msg_type": "", 2019-12-24T22:06:35.346 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_inject_delay_probability": "0.000000", 2019-12-24T22:06:35.346 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_inject_delay_type": "", 2019-12-24T22:06:35.347 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_inject_internal_delays": "0.000000", 2019-12-24T22:06:35.347 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_inject_socket_failures": "2500", 2019-12-24T22:06:35.347 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_learn_addr_from_peer": "true", 2019-12-24T22:06:35.347 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_max_accept_failures": "4", 2019-12-24T22:06:35.347 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_max_backoff": "15.000000", 2019-12-24T22:06:35.347 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_mon_client_mode": "secure crc", 2019-12-24T22:06:35.347 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_mon_cluster_mode": "secure crc", 2019-12-24T22:06:35.348 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_mon_service_mode": "secure crc", 2019-12-24T22:06:35.348 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2019-12-24T22:06:35.348 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_pq_min_cost": "65536", 2019-12-24T22:06:35.348 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_public_type": "", 2019-12-24T22:06:35.348 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_service_mode": "crc secure", 2019-12-24T22:06:35.348 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_tcp_listen_backlog": "512", 2019-12-24T22:06:35.348 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_tcp_nodelay": "true", 2019-12-24T22:06:35.349 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_tcp_prefetch_max_size": "4096", 2019-12-24T22:06:35.349 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_tcp_rcvbuf": "0", 2019-12-24T22:06:35.349 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_type": "async+posix", 2019-12-24T22:06:35.349 INFO:teuthology.orchestra.run.smithi037.stdout: "no_config_file": "false", 2019-12-24T22:06:35.349 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_completion_locks_per_session": "32", 2019-12-24T22:06:35.349 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_debug_inject_relock_delay": "false", 2019-12-24T22:06:35.349 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_inflight_op_bytes": "104857600", 2019-12-24T22:06:35.349 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_inflight_ops": "1024", 2019-12-24T22:06:35.350 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_inject_no_watch_ping": "false", 2019-12-24T22:06:35.350 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_retry_writes_after_first_reply": "false", 2019-12-24T22:06:35.350 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_tick_interval": "5.000000", 2019-12-24T22:06:35.350 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_timeout": "10.000000", 2019-12-24T22:06:35.350 INFO:teuthology.orchestra.run.smithi037.stdout: "objectstore_blackhole": "false", 2019-12-24T22:06:35.350 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_delay_time": "5.000000", 2019-12-24T22:06:35.350 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_hist_halflife": "1000", 2019-12-24T22:06:35.351 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_max_low_ops": "2", 2019-12-24T22:06:35.351 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_max_ops": "4", 2019-12-24T22:06:35.351 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_min_evict_effort": "0.100000", 2019-12-24T22:06:35.351 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_quantize_effort": "0.100000", 2019-12-24T22:06:35.351 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_slop": "0.020000", 2019-12-24T22:06:35.351 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_allow_recovery_below_min_size": "true", 2019-12-24T22:06:35.351 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_async_recovery_min_cost": "100", 2019-12-24T22:06:35.352 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_auto_mark_unfound_lost": "false", 2019-12-24T22:06:35.352 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_backfill_retry_interval": "30.000000", 2019-12-24T22:06:35.352 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_backfill_scan_max": "512", 2019-12-24T22:06:35.352 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_backfill_scan_min": "64", 2019-12-24T22:06:35.352 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_backoff_on_degraded": "false", 2019-12-24T22:06:35.352 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_backoff_on_peering": "false", 2019-12-24T22:06:35.352 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_backoff_on_unfound": "true", 2019-12-24T22:06:35.353 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_beacon_report_interval": "300", 2019-12-24T22:06:35.353 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bench_duration": "30", 2019-12-24T22:06:35.353 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bench_large_size_max_throughput": "104857600", 2019-12-24T22:06:35.353 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bench_max_block_size": "67108864", 2019-12-24T22:06:35.353 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bench_small_size_max_iops": "100", 2019-12-24T22:06:35.353 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_blkin_trace_all": "false", 2019-12-24T22:06:35.353 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2019-12-24T22:06:35.354 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2019-12-24T22:06:35.354 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_check_for_log_corruption": "false", 2019-12-24T22:06:35.354 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_check_max_object_name_len_on_startup": "true", 2019-12-24T22:06:35.354 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas", 2019-12-24T22:06:35.354 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2019-12-24T22:06:35.354 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas", 2019-12-24T22:06:35.354 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_class_update_on_start": "true", 2019-12-24T22:06:35.355 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_client_message_cap": "100", 2019-12-24T22:06:35.355 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_client_message_size_cap": "524288000", 2019-12-24T22:06:35.355 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_client_op_priority": "63", 2019-12-24T22:06:35.355 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_client_watch_timeout": "30", 2019-12-24T22:06:35.355 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_command_max_records": "256", 2019-12-24T22:06:35.355 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_command_thread_suicide_timeout": "900", 2019-12-24T22:06:35.355 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_command_thread_timeout": "600", 2019-12-24T22:06:35.356 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_copyfrom_max_chunk": "8388608", 2019-12-24T22:06:35.356 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_crush_chooseleaf_type": "1", 2019-12-24T22:06:35.356 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_crush_initial_weight": "-1.000000", 2019-12-24T22:06:35.356 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_crush_update_on_start": "true", 2019-12-24T22:06:35.356 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_crush_update_weight_set": "true", 2019-12-24T22:06:35.356 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2019-12-24T22:06:35.357 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2019-12-24T22:06:35.357 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2019-12-24T22:06:35.357 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_drop_ping_duration": "0", 2019-12-24T22:06:35.357 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_drop_ping_probability": "0.000000", 2019-12-24T22:06:35.357 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_feed_pullee": "-1", 2019-12-24T22:06:35.357 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_inject_copyfrom_error": "false", 2019-12-24T22:06:35.358 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2019-12-24T22:06:35.358 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2019-12-24T22:06:35.358 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_misdirected_ops": "false", 2019-12-24T22:06:35.358 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_no_acting_change": "false", 2019-12-24T22:06:35.358 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_no_purge_strays": "false", 2019-12-24T22:06:35.358 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_op_order": "false", 2019-12-24T22:06:35.358 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_pg_log_writeout": "false", 2019-12-24T22:06:35.359 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_pretend_recovery_active": "false", 2019-12-24T22:06:35.359 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_random_push_read_error": "0.000000", 2019-12-24T22:06:35.359 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2019-12-24T22:06:35.359 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_shutdown": "false", 2019-12-24T22:06:35.359 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2019-12-24T22:06:35.359 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2019-12-24T22:06:35.359 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_verify_cached_snaps": "false", 2019-12-24T22:06:35.360 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_verify_missing_on_start": "false", 2019-12-24T22:06:35.360 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_verify_snaps": "false", 2019-12-24T22:06:35.360 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_verify_stray_on_activate": "false", 2019-12-24T22:06:35.360 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_interval": "604800.000000", 2019-12-24T22:06:35.360 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_keys": "1024", 2019-12-24T22:06:35.360 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2019-12-24T22:06:35.361 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2019-12-24T22:06:35.361 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2019-12-24T22:06:35.361 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_stride": "524288", 2019-12-24T22:06:35.361 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2019-12-24T22:06:35.361 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_default_data_pool_replay_window": "45", 2019-12-24T22:06:35.361 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_default_notify_timeout": "30", 2019-12-24T22:06:35.361 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_delete_sleep": "0.000000", 2019-12-24T22:06:35.361 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_delete_sleep_hdd": "5.000000", 2019-12-24T22:06:35.362 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_delete_sleep_hybrid": "2.000000", 2019-12-24T22:06:35.362 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_delete_sleep_ssd": "0.000000", 2019-12-24T22:06:35.362 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_discard_disconnected_ops": "true", 2019-12-24T22:06:35.362 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_enable_op_tracker": "true", 2019-12-24T22:06:35.362 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_erasure_code_plugins": "jerasure lrc isa", 2019-12-24T22:06:35.362 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_failsafe_full_ratio": "0.970000", 2019-12-24T22:06:35.362 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_fast_fail_on_connection_refused": "true", 2019-12-24T22:06:35.363 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_fast_info": "true", 2019-12-24T22:06:35.363 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_fast_shutdown": "true", 2019-12-24T22:06:35.363 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_find_best_info_ignore_history_les": "false", 2019-12-24T22:06:35.363 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_force_auth_primary_missing_objects": "100", 2019-12-24T22:06:35.363 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2019-12-24T22:06:35.363 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_function_tracing": "false", 2019-12-24T22:06:35.363 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_grace": "20", 2019-12-24T22:06:35.364 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_interval": "6", 2019-12-24T22:06:35.364 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2019-12-24T22:06:35.364 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_min_peers": "10", 2019-12-24T22:06:35.364 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_min_size": "2000", 2019-12-24T22:06:35.364 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_stale": "600", 2019-12-24T22:06:35.364 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2019-12-24T22:06:35.364 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_hit_set_max_size": "100000", 2019-12-24T22:06:35.365 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_hit_set_min_size": "1000", 2019-12-24T22:06:35.365 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_hit_set_namespace": ".ceph-internal", 2019-12-24T22:06:35.365 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_ignore_stale_divergent_priors": "false", 2019-12-24T22:06:35.365 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2019-12-24T22:06:35.365 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_inject_failure_on_pg_removal": "false", 2019-12-24T22:06:35.365 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2019-12-24T22:06:35.365 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_journal_flush_on_shutdown": "true", 2019-12-24T22:06:35.366 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_journal_size": "5120", 2019-12-24T22:06:35.366 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_kill_backfill_at": "0", 2019-12-24T22:06:35.366 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_loop_before_reset_tphandle": "64", 2019-12-24T22:06:35.366 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_map_cache_size": "50", 2019-12-24T22:06:35.366 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_map_dedup": "true", 2019-12-24T22:06:35.366 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_map_message_max": "40", 2019-12-24T22:06:35.366 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_map_message_max_bytes": "10485760", 2019-12-24T22:06:35.367 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_map_share_max_epochs": "40", 2019-12-24T22:06:35.367 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_attr_name_len": "100", 2019-12-24T22:06:35.367 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_attr_size": "0", 2019-12-24T22:06:35.367 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_backfills": "1", 2019-12-24T22:06:35.367 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_markdown_count": "5", 2019-12-24T22:06:35.367 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_markdown_period": "600", 2019-12-24T22:06:35.367 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_object_name_len": "2048", 2019-12-24T22:06:35.367 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_object_namespace_len": "256", 2019-12-24T22:06:35.368 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_object_size": "134217728", 2019-12-24T22:06:35.368 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2019-12-24T22:06:35.368 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_omap_entries_per_request": "1024", 2019-12-24T22:06:35.368 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_pg_blocked_by": "16", 2019-12-24T22:06:35.368 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_pg_log_entries": "3000", 2019-12-24T22:06:35.368 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2019-12-24T22:06:35.368 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_pgls": "1024", 2019-12-24T22:06:35.369 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_push_cost": "8388608", 2019-12-24T22:06:35.369 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_push_objects": "10", 2019-12-24T22:06:35.369 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_scrubs": "1", 2019-12-24T22:06:35.369 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2019-12-24T22:06:35.369 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_trimming_pgs": "2", 2019-12-24T22:06:35.369 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_write_op_reply_len": "32", 2019-12-24T22:06:35.369 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_write_size": "90", 2019-12-24T22:06:35.370 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2019-12-24T22:06:35.370 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_background_best_effort_lim": "999999", 2019-12-24T22:06:35.370 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_background_best_effort_res": "1", 2019-12-24T22:06:35.370 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2019-12-24T22:06:35.370 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_background_recovery_lim": "999999", 2019-12-24T22:06:35.370 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_background_recovery_res": "1", 2019-12-24T22:06:35.370 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2019-12-24T22:06:35.371 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_client_lim": "999999", 2019-12-24T22:06:35.371 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_client_res": "1", 2019-12-24T22:06:35.371 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_client_wgt": "1", 2019-12-24T22:06:35.371 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_memory_base": "805306368", 2019-12-24T22:06:35.371 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_memory_cache_min": "134217728", 2019-12-24T22:06:35.371 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_memory_cache_resize_interval": "1.000000", 2019-12-24T22:06:35.371 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_memory_expected_fragmentation": "0.150000", 2019-12-24T22:06:35.372 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_memory_target": "4294967296", 2019-12-24T22:06:35.372 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2019-12-24T22:06:35.372 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_min_pg_log_entries": "3000", 2019-12-24T22:06:35.372 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_min_recovery_priority": "0", 2019-12-24T22:06:35.372 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mon_ack_timeout": "30.000000", 2019-12-24T22:06:35.372 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mon_heartbeat_interval": "30", 2019-12-24T22:06:35.372 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2019-12-24T22:06:35.373 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mon_report_interval": "5", 2019-12-24T22:06:35.373 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mon_report_max_in_flight": "2", 2019-12-24T22:06:35.373 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mon_shutdown_timeout": "5.000000", 2019-12-24T22:06:35.373 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_num_cache_shards": "32", 2019-12-24T22:06:35.373 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_num_op_tracker_shard": "32", 2019-12-24T22:06:35.373 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_numa_auto_affinity": "true", 2019-12-24T22:06:35.373 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_numa_node": "-1", 2019-12-24T22:06:35.373 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_numa_prefer_iface": "true", 2019-12-24T22:06:35.374 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_object_clean_region_max_num_intervals": "10", 2019-12-24T22:06:35.374 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_objecter_finishers": "1", 2019-12-24T22:06:35.374 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_objectstore": "bluestore", 2019-12-24T22:06:35.374 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_objectstore_fuse": "false", 2019-12-24T22:06:35.374 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_objectstore_tracing": "false", 2019-12-24T22:06:35.374 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_complaint_time": "30.000000", 2019-12-24T22:06:35.374 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_history_duration": "600", 2019-12-24T22:06:35.375 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_history_size": "20", 2019-12-24T22:06:35.375 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_history_slow_op_size": "20", 2019-12-24T22:06:35.375 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2019-12-24T22:06:35.375 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_log_threshold": "5", 2019-12-24T22:06:35.375 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_num_shards": "0", 2019-12-24T22:06:35.375 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_num_shards_hdd": "5", 2019-12-24T22:06:35.375 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_num_shards_ssd": "8", 2019-12-24T22:06:35.376 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_num_threads_per_shard": "0", 2019-12-24T22:06:35.376 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2019-12-24T22:06:35.376 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2019-12-24T22:06:35.376 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2019-12-24T22:06:35.376 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_pq_min_cost": "65536", 2019-12-24T22:06:35.376 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_queue": "wpq", 2019-12-24T22:06:35.376 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_queue_cut_off": "high", 2019-12-24T22:06:35.377 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_thread_suicide_timeout": "150", 2019-12-24T22:06:35.377 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_thread_timeout": "15", 2019-12-24T22:06:35.377 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_open_classes_on_start": "true", 2019-12-24T22:06:35.377 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_os_flags": "0", 2019-12-24T22:06:35.377 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_peering_op_priority": "255", 2019-12-24T22:06:35.377 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_delete_cost": "1048576", 2019-12-24T22:06:35.377 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_delete_priority": "5", 2019-12-24T22:06:35.378 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2019-12-24T22:06:35.378 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2019-12-24T22:06:35.378 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_log_dups_tracked": "3000", 2019-12-24T22:06:35.378 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_log_trim_max": "10000", 2019-12-24T22:06:35.378 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_log_trim_min": "100", 2019-12-24T22:06:35.378 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2019-12-24T22:06:35.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_object_context_cache_count": "64", 2019-12-24T22:06:35.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_stat_report_interval_max": "500", 2019-12-24T22:06:35.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2019-12-24T22:06:35.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_cache_min_evict_age": "0", 2019-12-24T22:06:35.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_cache_min_flush_age": "0", 2019-12-24T22:06:35.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2019-12-24T22:06:35.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2019-12-24T22:06:35.380 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2019-12-24T22:06:35.380 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_crush_rule": "-1", 2019-12-24T22:06:35.380 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_ec_fast_read": "false", 2019-12-24T22:06:35.380 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd", 2019-12-24T22:06:35.380 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_flag_hashpspool": "true", 2019-12-24T22:06:35.380 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_flag_nodelete": "false", 2019-12-24T22:06:35.380 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_flag_nopgchange": "false", 2019-12-24T22:06:35.381 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_flag_nosizechange": "false", 2019-12-24T22:06:35.381 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_flags": "0", 2019-12-24T22:06:35.381 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2019-12-24T22:06:35.381 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_min_size": "2", 2019-12-24T22:06:35.381 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2019-12-24T22:06:35.381 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_pg_num": "16", 2019-12-24T22:06:35.381 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_pgp_num": "0", 2019-12-24T22:06:35.382 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2019-12-24T22:06:35.382 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_size": "3", 2019-12-24T22:06:35.382 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_type": "replicated", 2019-12-24T22:06:35.382 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2019-12-24T22:06:35.382 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_use_gmt_hitset": "true", 2019-12-24T22:06:35.382 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_push_per_object_cost": "1000", 2019-12-24T22:06:35.382 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_read_ec_check_for_errors": "false", 2019-12-24T22:06:35.383 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recover_clone_overlap": "true", 2019-12-24T22:06:35.383 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recover_clone_overlap_limit": "10", 2019-12-24T22:06:35.383 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_cost": "20971520", 2019-12-24T22:06:35.383 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_delay_start": "0.000000", 2019-12-24T22:06:35.383 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_max_active": "0", 2019-12-24T22:06:35.383 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_max_active_hdd": "3", 2019-12-24T22:06:35.383 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_max_active_ssd": "10", 2019-12-24T22:06:35.383 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_max_chunk": "8388608", 2019-12-24T22:06:35.384 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2019-12-24T22:06:35.384 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_max_single_start": "1", 2019-12-24T22:06:35.384 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_op_priority": "3", 2019-12-24T22:06:35.384 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_op_warn_multiple": "16", 2019-12-24T22:06:35.384 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_priority": "5", 2019-12-24T22:06:35.384 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_retry_interval": "30.000000", 2019-12-24T22:06:35.384 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_sleep": "0.000000", 2019-12-24T22:06:35.385 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_sleep_hdd": "0.100000", 2019-12-24T22:06:35.385 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2019-12-24T22:06:35.385 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_sleep_ssd": "0.000000", 2019-12-24T22:06:35.385 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_repair_during_recovery": "false", 2019-12-24T22:06:35.385 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_requested_scrub_priority": "120", 2019-12-24T22:06:35.385 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_rollback_to_cluster_snap": "", 2019-12-24T22:06:35.385 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_auto_repair": "false", 2019-12-24T22:06:35.386 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_auto_repair_num_errors": "5", 2019-12-24T22:06:35.386 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_backoff_ratio": "0.660000", 2019-12-24T22:06:35.386 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_begin_hour": "0", 2019-12-24T22:06:35.386 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_begin_week_day": "0", 2019-12-24T22:06:35.386 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_chunk_max": "25", 2019-12-24T22:06:35.386 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_chunk_min": "5", 2019-12-24T22:06:35.386 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_cost": "52428800", 2019-12-24T22:06:35.386 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_during_recovery": "false", 2019-12-24T22:06:35.387 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_end_hour": "24", 2019-12-24T22:06:35.387 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_end_week_day": "7", 2019-12-24T22:06:35.387 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_extended_sleep": "0.000000", 2019-12-24T22:06:35.387 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2019-12-24T22:06:35.387 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_invalid_stats": "true", 2019-12-24T22:06:35.387 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_load_threshold": "0.500000", 2019-12-24T22:06:35.387 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_max_interval": "604800.000000", 2019-12-24T22:06:35.388 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_max_preemptions": "5", 2019-12-24T22:06:35.388 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_min_interval": "86400.000000", 2019-12-24T22:06:35.388 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_priority": "5", 2019-12-24T22:06:35.388 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_sleep": "0.000000", 2019-12-24T22:06:35.388 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_shutdown_pgref_assert": "false", 2019-12-24T22:06:35.388 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_skip_data_digest": "false", 2019-12-24T22:06:35.388 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_smart_report_timeout": "5", 2019-12-24T22:06:35.389 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_snap_trim_cost": "1048576", 2019-12-24T22:06:35.389 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_snap_trim_priority": "5", 2019-12-24T22:06:35.389 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_snap_trim_sleep": "0.000000", 2019-12-24T22:06:35.389 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2019-12-24T22:06:35.389 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2019-12-24T22:06:35.389 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2019-12-24T22:06:35.389 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_stats_ack_timeout_decay": "0.900000", 2019-12-24T22:06:35.390 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_stats_ack_timeout_factor": "2.000000", 2019-12-24T22:06:35.390 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_target_transaction_size": "30", 2019-12-24T22:06:35.390 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_hit_set_count": "4", 2019-12-24T22:06:35.390 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2019-12-24T22:06:35.390 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2019-12-24T22:06:35.390 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2019-12-24T22:06:35.390 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2019-12-24T22:06:35.391 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2019-12-24T22:06:35.391 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2019-12-24T22:06:35.391 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_mode": "writeback", 2019-12-24T22:06:35.391 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2019-12-24T22:06:35.391 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_promote_max_objects_sec": "25", 2019-12-24T22:06:35.391 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tracing": "false", 2019-12-24T22:06:35.391 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_use_stale_snap": "false", 2019-12-24T22:06:35.392 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2019-12-24T22:06:35.392 INFO:teuthology.orchestra.run.smithi037.stdout: "osdc_blkin_trace_all": "false", 2019-12-24T22:06:35.392 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_kill_at": "0", 2019-12-24T22:06:35.392 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_max_join_drift": "10", 2019-12-24T22:06:35.392 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_min": "500", 2019-12-24T22:06:35.392 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_min_wait": "0.050000", 2019-12-24T22:06:35.392 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_propose_interval": "1.000000", 2019-12-24T22:06:35.393 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_service_trim_max": "500", 2019-12-24T22:06:35.393 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_service_trim_min": "10", 2019-12-24T22:06:35.393 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_stash_full_interval": "25", 2019-12-24T22:06:35.393 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_trim_max": "500", 2019-12-24T22:06:35.393 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_trim_min": "250", 2019-12-24T22:06:35.393 INFO:teuthology.orchestra.run.smithi037.stdout: "perf": "true", 2019-12-24T22:06:35.393 INFO:teuthology.orchestra.run.smithi037.stdout: "pid_file": "", 2019-12-24T22:06:35.394 INFO:teuthology.orchestra.run.smithi037.stdout: "plugin_crypto_accelerator": "crypto_isal", 2019-12-24T22:06:35.394 INFO:teuthology.orchestra.run.smithi037.stdout: "plugin_dir": "/usr/lib64/ceph", 2019-12-24T22:06:35.394 INFO:teuthology.orchestra.run.smithi037.stdout: "prompt": "\u001b[01;33mCephFS:~\u001b[96m/\u001b[0m\u001b[01;33m>>>\u001b[00m ", 2019-12-24T22:06:35.394 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addr": "-", 2019-12-24T22:06:35.394 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addrv": "", 2019-12-24T22:06:35.394 INFO:teuthology.orchestra.run.smithi037.stdout: "public_bind_addr": "-", 2019-12-24T22:06:35.394 INFO:teuthology.orchestra.run.smithi037.stdout: "public_network": "", 2019-12-24T22:06:35.395 INFO:teuthology.orchestra.run.smithi037.stdout: "public_network_interface": "", 2019-12-24T22:06:35.395 INFO:teuthology.orchestra.run.smithi037.stdout: "qat_compressor_enabled": "false", 2019-12-24T22:06:35.395 INFO:teuthology.orchestra.run.smithi037.stdout: "quiet": "false", 2019-12-24T22:06:35.395 INFO:teuthology.orchestra.run.smithi037.stdout: "rados_mon_op_timeout": "0.000000", 2019-12-24T22:06:35.395 INFO:teuthology.orchestra.run.smithi037.stdout: "rados_osd_op_timeout": "0.000000", 2019-12-24T22:06:35.395 INFO:teuthology.orchestra.run.smithi037.stdout: "rados_tracing": "false", 2019-12-24T22:06:35.395 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_atime_update_interval": "60", 2019-12-24T22:06:35.396 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2019-12-24T22:06:35.396 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_balance_parent_reads": "false", 2019-12-24T22:06:35.396 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_balance_snap_reads": "false", 2019-12-24T22:06:35.396 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_blacklist_expire_seconds": "0", 2019-12-24T22:06:35.396 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_blacklist_on_break_lock": "true", 2019-12-24T22:06:35.396 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_blkin_trace_all": "false", 2019-12-24T22:06:35.396 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache": "true", 2019-12-24T22:06:35.397 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_block_writes_upfront": "false", 2019-12-24T22:06:35.397 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_max_dirty": "25165824", 2019-12-24T22:06:35.397 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_max_dirty_age": "1.000000", 2019-12-24T22:06:35.397 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_max_dirty_object": "0", 2019-12-24T22:06:35.397 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_policy": "writearound", 2019-12-24T22:06:35.397 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_size": "33554432", 2019-12-24T22:06:35.397 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_target_dirty": "16777216", 2019-12-24T22:06:35.398 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_writethrough_until_flush": "true", 2019-12-24T22:06:35.398 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_clone_copy_on_read": "false", 2019-12-24T22:06:35.398 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_concurrent_management_ops": "10", 2019-12-24T22:06:35.398 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_clone_format": "auto", 2019-12-24T22:06:35.398 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_data_pool": "", 2019-12-24T22:06:35.398 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_features": "61", 2019-12-24T22:06:35.398 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_format": "2", 2019-12-24T22:06:35.399 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_map_options": "", 2019-12-24T22:06:35.399 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_order": "22", 2019-12-24T22:06:35.399 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_pool": "rbd", 2019-12-24T22:06:35.399 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_stripe_count": "0", 2019-12-24T22:06:35.399 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_stripe_unit": "0", 2019-12-24T22:06:35.399 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_disable_zero_copy_writes": "true", 2019-12-24T22:06:35.400 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_discard_granularity_bytes": "65536", 2019-12-24T22:06:35.400 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_discard_on_zeroed_write_same": "true", 2019-12-24T22:06:35.400 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_enable_alloc_hint": "true", 2019-12-24T22:06:35.400 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_io_scheduler": "simple", 2019-12-24T22:06:35.400 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2019-12-24T22:06:35.400 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_commit_age": "5.000000", 2019-12-24T22:06:35.400 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2019-12-24T22:06:35.401 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_max_payload_bytes": "16384", 2019-12-24T22:06:35.401 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_object_flush_age": "0.000000", 2019-12-24T22:06:35.401 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_object_flush_bytes": "1048576", 2019-12-24T22:06:35.401 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_object_flush_interval": "0", 2019-12-24T22:06:35.401 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2019-12-24T22:06:35.401 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2019-12-24T22:06:35.401 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_order": "24", 2019-12-24T22:06:35.402 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_pool": "", 2019-12-24T22:06:35.402 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_splay_width": "4", 2019-12-24T22:06:35.402 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_localize_parent_reads": "false", 2019-12-24T22:06:35.402 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_localize_snap_reads": "false", 2019-12-24T22:06:35.402 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2019-12-24T22:06:35.402 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2019-12-24T22:06:35.402 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2019-12-24T22:06:35.403 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2019-12-24T22:06:35.403 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2019-12-24T22:06:35.403 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2019-12-24T22:06:35.403 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_image_policy_type": "simple", 2019-12-24T22:06:35.403 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2019-12-24T22:06:35.403 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_image_state_check_interval": "30", 2019-12-24T22:06:35.404 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2019-12-24T22:06:35.404 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2019-12-24T22:06:35.404 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2019-12-24T22:06:35.404 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2019-12-24T22:06:35.404 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2019-12-24T22:06:35.404 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_autotune": "true", 2019-12-24T22:06:35.404 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_base": "805306368", 2019-12-24T22:06:35.405 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2019-12-24T22:06:35.405 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_cache_min": "134217728", 2019-12-24T22:06:35.405 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2019-12-24T22:06:35.405 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2019-12-24T22:06:35.405 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_target": "4294967296", 2019-12-24T22:06:35.405 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_perf_stats_prio": "5", 2019-12-24T22:06:35.405 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2019-12-24T22:06:35.406 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2019-12-24T22:06:35.406 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirroring_delete_delay": "0", 2019-12-24T22:06:35.406 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirroring_max_mirroring_snapshots": "3", 2019-12-24T22:06:35.406 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirroring_replay_delay": "0", 2019-12-24T22:06:35.406 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2019-12-24T22:06:35.406 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2019-12-24T22:06:35.406 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_move_to_trash_on_remove": "false", 2019-12-24T22:06:35.407 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2019-12-24T22:06:35.407 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mtime_update_interval": "60", 2019-12-24T22:06:35.407 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_non_blocking_aio": "true", 2019-12-24T22:06:35.407 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_op_thread_timeout": "60", 2019-12-24T22:06:35.407 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_op_threads": "1", 2019-12-24T22:06:35.407 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_parent_cache_enabled": "false", 2019-12-24T22:06:35.407 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_bps_burst": "0", 2019-12-24T22:06:35.408 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_bps_limit": "0", 2019-12-24T22:06:35.408 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_iops_burst": "0", 2019-12-24T22:06:35.408 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_iops_limit": "0", 2019-12-24T22:06:35.408 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_read_bps_burst": "0", 2019-12-24T22:06:35.408 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_read_bps_limit": "0", 2019-12-24T22:06:35.408 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_read_iops_burst": "0", 2019-12-24T22:06:35.408 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_read_iops_limit": "0", 2019-12-24T22:06:35.409 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_schedule_tick_min": "50", 2019-12-24T22:06:35.409 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_write_bps_burst": "0", 2019-12-24T22:06:35.409 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_write_bps_limit": "0", 2019-12-24T22:06:35.409 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_write_iops_burst": "0", 2019-12-24T22:06:35.409 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_write_iops_limit": "0", 2019-12-24T22:06:35.409 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2019-12-24T22:06:35.409 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_readahead_max_bytes": "524288", 2019-12-24T22:06:35.410 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_readahead_trigger_requests": "10", 2019-12-24T22:06:35.410 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_request_timed_out_seconds": "30", 2019-12-24T22:06:35.410 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_rwl_enabled": "false", 2019-12-24T22:06:35.410 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_rwl_log_periodic_stats": "false", 2019-12-24T22:06:35.410 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_rwl_path": "/tmp", 2019-12-24T22:06:35.410 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_rwl_size": "1073741824", 2019-12-24T22:06:35.410 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_skip_partial_discard": "true", 2019-12-24T22:06:35.411 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2019-12-24T22:06:35.411 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_tracing": "false", 2019-12-24T22:06:35.411 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_validate_names": "true", 2019-12-24T22:06:35.411 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_validate_pool": "true", 2019-12-24T22:06:35.411 INFO:teuthology.orchestra.run.smithi037.stdout: "restapi_base_url": "", 2019-12-24T22:06:35.411 INFO:teuthology.orchestra.run.smithi037.stdout: "restapi_log_level": "", 2019-12-24T22:06:35.411 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_acl_grants_max_num": "100", 2019-12-24T22:06:35.412 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_admin_entry": "admin", 2019-12-24T22:06:35.412 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_barbican_url": "", 2019-12-24T22:06:35.412 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2019-12-24T22:06:35.412 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_default_quota_max_size": "-1", 2019-12-24T22:06:35.412 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_index_max_aio": "128", 2019-12-24T22:06:35.412 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_quota_cache_size": "10000", 2019-12-24T22:06:35.412 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_quota_soft_threshold": "0.950000", 2019-12-24T22:06:35.412 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_quota_ttl": "600", 2019-12-24T22:06:35.413 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_cache_enabled": "true", 2019-12-24T22:06:35.413 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_cache_expiry_interval": "900", 2019-12-24T22:06:35.413 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_cache_lru_size": "10000", 2019-12-24T22:06:35.413 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_content_length_compat": "false", 2019-12-24T22:06:35.413 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_copy_obj_progress": "true", 2019-12-24T22:06:35.413 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2019-12-24T22:06:35.413 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_cors_rules_max_num": "100", 2019-12-24T22:06:35.414 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_cross_domain_policy": "", 2019-12-24T22:06:35.414 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_default_encryption_key": "", 2019-12-24T22:06:35.414 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_require_ssl": "true", 2019-12-24T22:06:35.414 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2019-12-24T22:06:35.414 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2019-12-24T22:06:35.414 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_suppress_logs": "true", 2019-12-24T22:06:35.414 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_addr": "", 2019-12-24T22:06:35.415 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_auth": "token", 2019-12-24T22:06:35.415 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_namespace": "", 2019-12-24T22:06:35.415 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_prefix": "", 2019-12-24T22:06:35.415 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_secret_engine": "transit", 2019-12-24T22:06:35.415 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_token_file": "", 2019-12-24T22:06:35.415 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_curl_low_speed_limit": "1024", 2019-12-24T22:06:35.415 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_curl_low_speed_time": "300", 2019-12-24T22:06:35.416 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_curl_wait_timeout_ms": "1000", 2019-12-24T22:06:35.416 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2019-12-24T22:06:35.416 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data_log_changes_size": "1000", 2019-12-24T22:06:35.416 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data_log_num_shards": "128", 2019-12-24T22:06:35.416 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data_log_obj_prefix": "data_log", 2019-12-24T22:06:35.416 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data_log_window": "30", 2019-12-24T22:06:35.416 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data_notify_interval_msec": "200", 2019-12-24T22:06:35.417 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_default_realm_info_oid": "default.realm", 2019-12-24T22:06:35.417 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_default_region_info_oid": "default.region", 2019-12-24T22:06:35.417 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_default_zone_info_oid": "default.zone", 2019-12-24T22:06:35.417 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2019-12-24T22:06:35.417 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_defer_to_bucket_acls": "", 2019-12-24T22:06:35.417 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_delete_multi_obj_max_num": "1000", 2019-12-24T22:06:35.417 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_admin_lim": "0.000000", 2019-12-24T22:06:35.418 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_admin_res": "100.000000", 2019-12-24T22:06:35.418 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2019-12-24T22:06:35.418 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_auth_lim": "0.000000", 2019-12-24T22:06:35.418 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_auth_res": "200.000000", 2019-12-24T22:06:35.418 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2019-12-24T22:06:35.418 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_data_lim": "0.000000", 2019-12-24T22:06:35.418 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_data_res": "500.000000", 2019-12-24T22:06:35.418 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_data_wgt": "500.000000", 2019-12-24T22:06:35.419 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2019-12-24T22:06:35.419 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_metadata_res": "500.000000", 2019-12-24T22:06:35.419 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2019-12-24T22:06:35.419 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dns_name": "", 2019-12-24T22:06:35.419 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dns_s3website_name": "", 2019-12-24T22:06:35.419 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dynamic_resharding": "true", 2019-12-24T22:06:35.419 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, pubsub", 2019-12-24T22:06:35.420 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_gc_threads": "true", 2019-12-24T22:06:35.420 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_lc_threads": "true", 2019-12-24T22:06:35.420 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_ops_log": "false", 2019-12-24T22:06:35.420 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_quota_threads": "true", 2019-12-24T22:06:35.420 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_static_website": "false", 2019-12-24T22:06:35.420 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_usage_log": "false", 2019-12-24T22:06:35.420 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enforce_swift_acls": "true", 2019-12-24T22:06:35.421 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_exit_timeout_secs": "120", 2019-12-24T22:06:35.421 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_expose_bucket": "false", 2019-12-24T22:06:35.421 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_extended_http_attrs": "", 2019-12-24T22:06:35.421 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_fcgi_socket_backlog": "1024", 2019-12-24T22:06:35.421 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_frontends": "beast port=7480", 2019-12-24T22:06:35.421 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_max_concurrent_io": "10", 2019-12-24T22:06:35.421 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_max_deferred": "50", 2019-12-24T22:06:35.422 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2019-12-24T22:06:35.422 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_max_objs": "32", 2019-12-24T22:06:35.422 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_max_queue_size": "134213632", 2019-12-24T22:06:35.422 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_max_trim_chunk": "16", 2019-12-24T22:06:35.422 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_obj_min_wait": "7200", 2019-12-24T22:06:35.422 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_processor_max_time": "3600", 2019-12-24T22:06:35.423 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_processor_period": "3600", 2019-12-24T22:06:35.423 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_get_obj_max_req_size": "4194304", 2019-12-24T22:06:35.423 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_get_obj_window_size": "16777216", 2019-12-24T22:06:35.423 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_healthcheck_disabling_path": "", 2019-12-24T22:06:35.423 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_host": "", 2019-12-24T22:06:35.423 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ignore_get_invalid_range": "false", 2019-12-24T22:06:35.424 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_init_timeout": "300", 2019-12-24T22:06:35.424 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2019-12-24T22:06:35.424 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_accepted_admin_roles": "", 2019-12-24T22:06:35.424 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2019-12-24T22:06:35.424 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_domain": "", 2019-12-24T22:06:35.424 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_password": "", 2019-12-24T22:06:35.424 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_password_path": "", 2019-12-24T22:06:35.425 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_project": "", 2019-12-24T22:06:35.425 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_tenant": "", 2019-12-24T22:06:35.425 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_token": "", 2019-12-24T22:06:35.425 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_token_path": "", 2019-12-24T22:06:35.425 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_user": "", 2019-12-24T22:06:35.425 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_api_version": "2", 2019-12-24T22:06:35.425 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_barbican_domain": "", 2019-12-24T22:06:35.425 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_barbican_password": "", 2019-12-24T22:06:35.426 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_barbican_project": "", 2019-12-24T22:06:35.426 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_barbican_tenant": "", 2019-12-24T22:06:35.426 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_barbican_user": "", 2019-12-24T22:06:35.426 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_implicit_tenants": "false", 2019-12-24T22:06:35.426 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_token_cache_size": "10000", 2019-12-24T22:06:35.426 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_url": "", 2019-12-24T22:06:35.426 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_verify_ssl": "true", 2019-12-24T22:06:35.427 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lc_debug_interval": "-1", 2019-12-24T22:06:35.427 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lc_lock_max_time": "60", 2019-12-24T22:06:35.427 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lc_max_objs": "32", 2019-12-24T22:06:35.427 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lc_max_rules": "1000", 2019-12-24T22:06:35.427 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lc_thread_delay": "0", 2019-12-24T22:06:35.427 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2019-12-24T22:06:35.427 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ldap_dnattr": "uid", 2019-12-24T22:06:35.428 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2019-12-24T22:06:35.428 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ldap_searchfilter": "", 2019-12-24T22:06:35.428 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2019-12-24T22:06:35.428 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ldap_uri": "ldaps://", 2019-12-24T22:06:35.428 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2019-12-24T22:06:35.428 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_list_bucket_min_readahead": "1000", 2019-12-24T22:06:35.429 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_list_buckets_max_chunk": "1000", 2019-12-24T22:06:35.429 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_log_http_headers": "", 2019-12-24T22:06:35.429 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_log_nonexistent_bucket": "false", 2019-12-24T22:06:35.429 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2019-12-24T22:06:35.429 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_log_object_name_utc": "false", 2019-12-24T22:06:35.430 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_attr_name_len": "0", 2019-12-24T22:06:35.430 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_attr_size": "0", 2019-12-24T22:06:35.430 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_attrs_num_in_req": "0", 2019-12-24T22:06:35.430 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_chunk_size": "4194304", 2019-12-24T22:06:35.430 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_concurrent_requests": "1024", 2019-12-24T22:06:35.430 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_dynamic_shards": "1999", 2019-12-24T22:06:35.430 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_listing_results": "1000", 2019-12-24T22:06:35.431 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_notify_retries": "3", 2019-12-24T22:06:35.431 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_objs_per_shard": "100000", 2019-12-24T22:06:35.431 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_put_param_size": "1048576", 2019-12-24T22:06:35.431 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_put_size": "5368709120", 2019-12-24T22:06:35.431 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_slo_entries": "1000", 2019-12-24T22:06:35.431 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_md_log_max_shards": "64", 2019-12-24T22:06:35.431 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_md_notify_interval_msec": "200", 2019-12-24T22:06:35.432 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_mime_types_file": "/etc/mime.types", 2019-12-24T22:06:35.432 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_mp_lock_max_time": "600", 2019-12-24T22:06:35.432 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_multipart_min_part_size": "5242880", 2019-12-24T22:06:35.432 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_multipart_part_upload_limit": "10000", 2019-12-24T22:06:35.432 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_fhcache_partitions": "3", 2019-12-24T22:06:35.432 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_fhcache_size": "2017", 2019-12-24T22:06:35.432 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2019-12-24T22:06:35.432 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_lru_lanes": "5", 2019-12-24T22:06:35.433 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_max_gc": "300", 2019-12-24T22:06:35.433 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_namespace_expire_secs": "300", 2019-12-24T22:06:35.433 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_s3_fast_attrs": "false", 2019-12-24T22:06:35.433 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_write_completion_interval_s": "10", 2019-12-24T22:06:35.433 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_num_async_rados_threads": "32", 2019-12-24T22:06:35.433 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_num_control_oids": "8", 2019-12-24T22:06:35.433 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_num_rados_handles": "1", 2019-12-24T22:06:35.434 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_obj_stripe_size": "4194304", 2019-12-24T22:06:35.434 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_obj_tombstone_cache_size": "1000", 2019-12-24T22:06:35.434 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_objexp_chunk_size": "100", 2019-12-24T22:06:35.434 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_objexp_gc_interval": "600", 2019-12-24T22:06:35.434 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_objexp_hints_num_shards": "127", 2019-12-24T22:06:35.434 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_olh_pending_timeout_sec": "3600", 2019-12-24T22:06:35.434 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_op_thread_suicide_timeout": "0", 2019-12-24T22:06:35.435 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_op_thread_timeout": "600", 2019-12-24T22:06:35.435 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_op_tracing": "false", 2019-12-24T22:06:35.435 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_opa_token": "", 2019-12-24T22:06:35.435 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_opa_url": "", 2019-12-24T22:06:35.435 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_opa_verify_ssl": "true", 2019-12-24T22:06:35.435 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ops_log_data_backlog": "5242880", 2019-12-24T22:06:35.435 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ops_log_rados": "true", 2019-12-24T22:06:35.436 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ops_log_socket_path": "", 2019-12-24T22:06:35.436 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_override_bucket_index_max_shards": "0", 2019-12-24T22:06:35.436 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2019-12-24T22:06:35.436 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_period_push_interval": "2.000000", 2019-12-24T22:06:35.436 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_period_push_interval_max": "30.000000", 2019-12-24T22:06:35.436 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_period_root_pool": ".rgw.root", 2019-12-24T22:06:35.436 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_port": "", 2019-12-24T22:06:35.437 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_print_continue": "true", 2019-12-24T22:06:35.437 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_print_prohibited_content_length": "false", 2019-12-24T22:06:35.437 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_put_obj_max_window_size": "67108864", 2019-12-24T22:06:35.437 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_put_obj_min_window_size": "16777216", 2019-12-24T22:06:35.437 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2019-12-24T22:06:35.437 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_rados_pool_pg_num_min": "8", 2019-12-24T22:06:35.438 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_rados_pool_recovery_priority": "5", 2019-12-24T22:06:35.438 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_rados_tracing": "false", 2019-12-24T22:06:35.438 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_realm": "", 2019-12-24T22:06:35.438 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_realm_root_pool": ".rgw.root", 2019-12-24T22:06:35.438 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_region": "", 2019-12-24T22:06:35.438 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_region_root_pool": ".rgw.root", 2019-12-24T22:06:35.439 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_relaxed_region_enforcement": "false", 2019-12-24T22:06:35.439 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_relaxed_s3_bucket_names": "false", 2019-12-24T22:06:35.439 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2019-12-24T22:06:35.439 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_request_uri": "", 2019-12-24T22:06:35.439 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_reshard_batch_size": "64", 2019-12-24T22:06:35.439 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_reshard_bucket_lock_duration": "360", 2019-12-24T22:06:35.439 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_reshard_max_aio": "128", 2019-12-24T22:06:35.440 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_reshard_num_logs": "16", 2019-12-24T22:06:35.440 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_reshard_thread_interval": "600", 2019-12-24T22:06:35.440 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_resolve_cname": "false", 2019-12-24T22:06:35.440 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_rest_getusage_op_compat": "false", 2019-12-24T22:06:35.440 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_run_sync_thread": "true", 2019-12-24T22:06:35.440 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_auth_order": "sts, external, local", 2019-12-24T22:06:35.440 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_auth_use_keystone": "false", 2019-12-24T22:06:35.441 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_auth_use_ldap": "false", 2019-12-24T22:06:35.441 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_auth_use_rados": "true", 2019-12-24T22:06:35.441 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_auth_use_sts": "false", 2019-12-24T22:06:35.441 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_success_create_obj_status": "0", 2019-12-24T22:06:35.441 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_safe_max_objects_per_shard": "102400", 2019-12-24T22:06:35.441 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_scheduler_type": "throttler", 2019-12-24T22:06:35.441 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_script_uri": "", 2019-12-24T22:06:35.442 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_service_provider_name": "", 2019-12-24T22:06:35.442 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_shard_warning_threshold": "90.000000", 2019-12-24T22:06:35.442 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_socket_path": "", 2019-12-24T22:06:35.442 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sts_client_id": "", 2019-12-24T22:06:35.442 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sts_client_secret": "", 2019-12-24T22:06:35.442 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sts_entry": "sts", 2019-12-24T22:06:35.442 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sts_key": "sts", 2019-12-24T22:06:35.443 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sts_max_session_duration": "43200", 2019-12-24T22:06:35.443 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sts_token_introspection_url": "", 2019-12-24T22:06:35.443 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_account_in_url": "false", 2019-12-24T22:06:35.443 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_auth_entry": "auth", 2019-12-24T22:06:35.443 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_auth_url": "", 2019-12-24T22:06:35.443 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_custom_header": "", 2019-12-24T22:06:35.443 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_enforce_content_length": "false", 2019-12-24T22:06:35.444 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_need_stats": "true", 2019-12-24T22:06:35.444 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_tenant_name": "", 2019-12-24T22:06:35.444 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_token_expiration": "86400", 2019-12-24T22:06:35.444 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_url": "", 2019-12-24T22:06:35.444 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_url_prefix": "swift", 2019-12-24T22:06:35.444 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_versioning_enabled": "false", 2019-12-24T22:06:35.444 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2019-12-24T22:06:35.445 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_lease_period": "120", 2019-12-24T22:06:35.445 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2019-12-24T22:06:35.445 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_log_trim_interval": "1200", 2019-12-24T22:06:35.445 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_log_trim_max_buckets": "16", 2019-12-24T22:06:35.445 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2019-12-24T22:06:35.445 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2019-12-24T22:06:35.446 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_trace_history_size": "4096", 2019-12-24T22:06:35.446 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_trace_per_node_log_size": "32", 2019-12-24T22:06:35.446 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2019-12-24T22:06:35.446 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_thread_pool_size": "512", 2019-12-24T22:06:35.446 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_comment": "", 2019-12-24T22:06:35.446 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_createby": "", 2019-12-24T22:06:35.446 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_encoding": "", 2019-12-24T22:06:35.447 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_flag": "false", 2019-12-24T22:06:35.447 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_origin": "", 2019-12-24T22:06:35.447 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_sha_unit": "524288", 2019-12-24T22:06:35.447 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_tracker": "", 2019-12-24T22:06:35.447 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_trust_forwarded_https": "false", 2019-12-24T22:06:35.447 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_usage_log_flush_threshold": "1024", 2019-12-24T22:06:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_usage_log_tick_interval": "30", 2019-12-24T22:06:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_usage_max_shards": "32", 2019-12-24T22:06:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_usage_max_user_shards": "1", 2019-12-24T22:06:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_use_opa_authz": "false", 2019-12-24T22:06:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_default_quota_max_objects": "-1", 2019-12-24T22:06:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_default_quota_max_size": "-1", 2019-12-24T22:06:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_max_buckets": "1000", 2019-12-24T22:06:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2019-12-24T22:06:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_quota_sync_idle_users": "false", 2019-12-24T22:06:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_quota_sync_interval": "86400", 2019-12-24T22:06:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_quota_sync_wait_time": "86400", 2019-12-24T22:06:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_unique_email": "true", 2019-12-24T22:06:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_verify_ssl": "true", 2019-12-24T22:06:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_website_routing_rules_max_num": "50", 2019-12-24T22:06:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_zone": "", 2019-12-24T22:06:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_zone_root_pool": ".rgw.root", 2019-12-24T22:06:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_zonegroup": "", 2019-12-24T22:06:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2019-12-24T22:06:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_block_size": "4096", 2019-12-24T22:06:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_bloom_bits_per_key": "20", 2019-12-24T22:06:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2019-12-24T22:06:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "true", 2019-12-24T22:06:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cache_row_ratio": "0.000000", 2019-12-24T22:06:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cache_shard_bits": "4", 2019-12-24T22:06:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cache_size": "536870912", 2019-12-24T22:06:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cache_type": "binned_lru", 2019-12-24T22:06:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_collect_compaction_stats": "false", 2019-12-24T22:06:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_collect_extended_stats": "false", 2019-12-24T22:06:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_collect_memory_stats": "false", 2019-12-24T22:06:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_delete_range_threshold": "1024", 2019-12-24T22:06:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_index_type": "binary_search", 2019-12-24T22:06:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_log_to_ceph_log": "true", 2019-12-24T22:06:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_metadata_block_size": "4096", 2019-12-24T22:06:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_partition_filters": "false", 2019-12-24T22:06:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_perf": "false", 2019-12-24T22:06:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2019-12-24T22:06:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: "rotating_keys_bootstrap_timeout": "30", 2019-12-24T22:06:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: "rotating_keys_renewal_timeout": "10", 2019-12-24T22:06:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: "run_dir": "/var/run/ceph", 2019-12-24T22:06:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: "setgroup": "ceph", 2019-12-24T22:06:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: "setuser": "ceph", 2019-12-24T22:06:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: "setuser_match_path": "", 2019-12-24T22:06:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_misplaced_ratio": "0.050000", 2019-12-24T22:06:35.454 INFO:teuthology.orchestra.run.smithi037.stdout: "thp": "false", 2019-12-24T22:06:35.454 INFO:teuthology.orchestra.run.smithi037.stdout: "threadpool_default_timeout": "60", 2019-12-24T22:06:35.454 INFO:teuthology.orchestra.run.smithi037.stdout: "threadpool_empty_queue_max_wait": "2", 2019-12-24T22:06:35.454 INFO:teuthology.orchestra.run.smithi037.stdout: "throttler_perf_counter": "true", 2019-12-24T22:06:35.454 INFO:teuthology.orchestra.run.smithi037.stdout: "timing": "false" 2019-12-24T22:06:35.454 INFO:teuthology.orchestra.run.smithi037.stdout:} 2019-12-24T22:06:35.739 INFO:tasks.cephadm.ceph_manager.ceph:asok exitstatus = 0 2019-12-24T22:06:35.739 INFO:tasks.cephadm.ceph_manager.ceph:stdout= { "name": "mon.a", "cluster": "ceph", "admin_socket": "/var/run/ceph/ceph-mon.a.asok", "admin_socket_mode": "", "allow_ansi": "Terminal", "auth_client_required": "cephx, none", "auth_cluster_required": "cephx", "auth_debug": "true", "auth_mon_ticket_ttl": "43200.000000", "auth_service_required": "cephx", "auth_service_ticket_ttl": "3600.000000", "auth_supported": "", "bdev_aio": "true", "bdev_aio_max_queue_depth": "1024", "bdev_aio_poll_ms": "250", "bdev_aio_reap_max": "16", "bdev_async_discard": "false", "bdev_block_size": "4096", "bdev_debug_aio": "false", "bdev_debug_aio_log_age": "5.000000", "bdev_debug_aio_suicide_timeout": "60.000000", "bdev_debug_inflight_ios": "false", "bdev_enable_discard": "false", "bdev_inject_crash": "0", "bdev_inject_crash_flush_delay": "2", "bdev_nvme_retry_count": "-1", "bdev_nvme_unbind_from_kernel": "false", "bluefs_alloc_size": "1048576", "bluefs_allocator": "bitmap", "bluefs_buffered_io": "true", "bluefs_compact_log_sync": "false", "bluefs_log_compact_min_ratio": "5.000000", "bluefs_log_compact_min_size": "16777216", "bluefs_log_replay_check_allocations": "true", "bluefs_max_log_runway": "4194304", "bluefs_max_prefetch": "1048576", "bluefs_min_flush_size": "524288", "bluefs_min_log_runway": "1048576", "bluefs_preextend_wal_files": "true", "bluefs_shared_alloc_size": "65536", "bluefs_sync_write": "false", "bluestore_2q_cache_kin_ratio": "0.500000", "bluestore_2q_cache_kout_ratio": "0.500000", "bluestore_allocator": "bitmap", "bluestore_avl_alloc_bf_free_pct": "4", "bluestore_avl_alloc_bf_threshold": "131072", "bluestore_bitmapallocator_blocks_per_zone": "1024", "bluestore_bitmapallocator_span_size": "1024", "bluestore_blobid_prealloc": "10240", "bluestore_block_create": "true", "bluestore_block_db_create": "false", "bluestore_block_db_path": "", "bluestore_block_db_size": "0", "bluestore_block_path": "", "bluestore_block_preallocate_file": "false", "bluestore_block_size": "107374182400", "bluestore_block_wal_create": "false", "bluestore_block_wal_path": "", "bluestore_block_wal_size": "100663296", "bluestore_bluefs": "true", "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", "bluestore_bluefs_balance_interval": "1.000000", "bluestore_bluefs_db_compatibility": "true", "bluestore_bluefs_env_mirror": "false", "bluestore_bluefs_gift_ratio": "0.020000", "bluestore_bluefs_max_free": "10737418240", "bluestore_bluefs_max_ratio": "0.900000", "bluestore_bluefs_min": "1073741824", "bluestore_bluefs_min_free": "1073741824", "bluestore_bluefs_min_ratio": "0.020000", "bluestore_bluefs_reclaim_ratio": "0.200000", "bluestore_cache_autotune": "true", "bluestore_cache_autotune_interval": "5.000000", "bluestore_cache_kv_ratio": "0.400000", "bluestore_cache_meta_ratio": "0.400000", "bluestore_cache_size": "0", "bluestore_cache_size_hdd": "1073741824", "bluestore_cache_size_ssd": "3221225472", "bluestore_cache_trim_interval": "0.050000", "bluestore_cache_trim_max_skip_pinned": "64", "bluestore_cache_type": "2q", "bluestore_clone_cow": "true", "bluestore_compression_algorithm": "snappy", "bluestore_compression_max_blob_size": "0", "bluestore_compression_max_blob_size_hdd": "524288", "bluestore_compression_max_blob_size_ssd": "65536", "bluestore_compression_min_blob_size": "0", "bluestore_compression_min_blob_size_hdd": "131072", "bluestore_compression_min_blob_size_ssd": "8192", "bluestore_compression_mode": "none", "bluestore_compression_required_ratio": "0.875000", "bluestore_csum_type": "crc32c", "bluestore_debug_enforce_settings": "default", "bluestore_debug_freelist": "false", "bluestore_debug_fsck_abort": "false", "bluestore_debug_inject_bug21040": "false", "bluestore_debug_inject_csum_err_probability": "0.000000", "bluestore_debug_inject_read_err": "false", "bluestore_debug_misc": "false", "bluestore_debug_no_reuse_blocks": "false", "bluestore_debug_omit_block_device_write": "false", "bluestore_debug_omit_kv_commit": "false", "bluestore_debug_permit_any_bdev_label": "false", "bluestore_debug_prefill": "0.000000", "bluestore_debug_prefragment_max": "1048576", "bluestore_debug_random_read_err": "0.000000", "bluestore_debug_randomize_serial_transaction": "0", "bluestore_debug_small_allocations": "0", "bluestore_debug_too_many_blobs_threshold": "24576", "bluestore_default_buffered_read": "true", "bluestore_default_buffered_write": "false", "bluestore_deferred_batch_ops": "0", "bluestore_deferred_batch_ops_hdd": "64", "bluestore_deferred_batch_ops_ssd": "16", "bluestore_extent_map_inline_shard_prealloc_size": "256", "bluestore_extent_map_shard_max_size": "1200", "bluestore_extent_map_shard_min_size": "150", "bluestore_extent_map_shard_target_size": "500", "bluestore_extent_map_shard_target_size_slop": "0.200000", "bluestore_freelist_blocks_per_key": "128", "bluestore_fsck_error_on_no_per_pool_omap": "false", "bluestore_fsck_error_on_no_per_pool_stats": "false", "bluestore_fsck_on_mkfs": "true", "bluestore_fsck_on_mkfs_deep": "false", "bluestore_fsck_on_mount": "false", "bluestore_fsck_on_mount_deep": "false", "bluestore_fsck_on_umount": "false", "bluestore_fsck_on_umount_deep": "false", "bluestore_fsck_quick_fix_on_mount": "true", "bluestore_fsck_quick_fix_threads": "2", "bluestore_fsck_read_bytes_cap": "67108864", "bluestore_gc_enable_blob_threshold": "0", "bluestore_gc_enable_total_threshold": "0", "bluestore_ignore_data_csum": "false", "bluestore_ioring": "false", "bluestore_kvbackend": "rocksdb", "bluestore_log_collection_list_age": "60.000000", "bluestore_log_omap_iterator_age": "5.000000", "bluestore_log_op_age": "5.000000", "bluestore_max_alloc_size": "0", "bluestore_max_blob_size": "0", "bluestore_max_blob_size_hdd": "524288", "bluestore_max_blob_size_ssd": "65536", "bluestore_max_defer_interval": "3.000000", "bluestore_max_deferred_txc": "32", "bluestore_min_alloc_size": "0", "bluestore_min_alloc_size_hdd": "4096", "bluestore_min_alloc_size_ssd": "4096", "bluestore_nid_prealloc": "1024", "bluestore_prefer_deferred_size": "0", "bluestore_prefer_deferred_size_hdd": "32768", "bluestore_prefer_deferred_size_ssd": "0", "bluestore_retry_disk_reads": "3", "bluestore_rocksdb_cf": "false", "bluestore_rocksdb_cfs": "M= P= L=", "bluestore_rocksdb_options": "compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2", "bluestore_spdk_coremask": "0x1", "bluestore_spdk_io_sleep": "5", "bluestore_spdk_max_io_completion": "0", "bluestore_spdk_mem": "512", "bluestore_sync_submit_transaction": "false", "bluestore_throttle_bytes": "67108864", "bluestore_throttle_cost_per_io": "0", "bluestore_throttle_cost_per_io_hdd": "670000", "bluestore_throttle_cost_per_io_ssd": "4000", "bluestore_throttle_deferred_bytes": "134217728", "bluestore_throttle_trace_rate": "0.000000", "bluestore_tracing": "false", "bluestore_volume_selection_policy": "rocksdb_original", "bluestore_volume_selection_reserved": "0", "bluestore_volume_selection_reserved_factor": "2.000000", "bluestore_warn_on_bluefs_spillover": "true", "bluestore_warn_on_legacy_statfs": "true", "bluestore_warn_on_no_per_pool_omap": "true", "cephadm_path": "/usr/sbin/cephadm", "cephx_cluster_require_signatures": "false", "cephx_cluster_require_version": "1", "cephx_require_signatures": "false", "cephx_require_version": "1", "cephx_service_require_signatures": "false", "cephx_service_require_version": "1", "cephx_sign_messages": "true", "chdir": "", "client_acl_type": "", "client_cache_mid": "0.750000", "client_cache_size": "16384", "client_caps_release_delay": "5", "client_check_pool_perm": "true", "client_debug_force_sync_read": "false", "client_debug_getattr_caps": "false", "client_debug_inject_tick_delay": "0", "client_die_on_failed_dentry_invalidate": "true", "client_die_on_failed_remount": "false", "client_dirsize_rbytes": "true", "client_force_lazyio": "false", "client_inject_fixed_oldest_tid": "false", "client_inject_release_failure": "false", "client_max_inline_size": "4096", "client_mds_namespace": "", "client_metadata": "", "client_mount_gid": "-1", "client_mount_timeout": "300.000000", "client_mount_uid": "-1", "client_mountpoint": "/", "client_notify_timeout": "10", "client_oc": "true", "client_oc_max_dirty": "104857600", "client_oc_max_dirty_age": "5.000000", "client_oc_max_objects": "1000", "client_oc_size": "209715200", "client_oc_target_dirty": "8388608", "client_permissions": "true", "client_quota_df": "true", "client_readahead_max_bytes": "0", "client_readahead_max_periods": "4", "client_readahead_min": "131072", "client_reconnect_stale": "false", "client_snapdir": ".snap", "client_tick_interval": "1.000000", "client_trace": "", "client_try_dentry_invalidate": "false", "client_use_faked_inos": "false", "client_use_random_mds": "false", "clog_to_graylog": "false", "clog_to_graylog_host": "127.0.0.1", "clog_to_graylog_port": "12201", "clog_to_monitors": "default=true", "clog_to_syslog": "false", "clog_to_syslog_facility": "default=daemon audit=local0", "clog_to_syslog_level": "info", "cluster_addr": "-", "cluster_network": "", "cluster_network_interface": "", "colors": "Terminal", "compressor_zlib_isal": "false", "compressor_zlib_level": "5", "container_image": "quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01", "continuation_prompt": ">", "crash_dir": "/var/lib/ceph/crash", "crimson_osd_obc_lru_size": "10", "crush_location": "", "crush_location_hook": "", "crush_location_hook_timeout": "10", "daemonize": "false", "debug_allow_any_pool_priority": "false", "debug_asok": "1/5", "debug_asok_assert_abort": "false", "debug_asserts_on_shutdown": "true", "debug_auth": "1/5", "debug_bdev": "1/3", "debug_bluefs": "1/5", "debug_bluestore": "1/5", "debug_buffer": "0/1", "debug_civetweb": "1/10", "debug_client": "0/5", "debug_compressor": "1/5", "debug_context": "0/1", "debug_crush": "1/1", "debug_crypto": "1/5", "debug_deliberately_leak_memory": "false", "debug_disable_randomized_ping": "false", "debug_dpdk": "1/5", "debug_eventtrace": "1/5", "debug_filer": "0/1", "debug_filestore": "1/3", "debug_finisher": "1/1", "debug_fuse": "1/5", "debug_heartbeat_testing_span": "0", "debug_heartbeatmap": "1/5", "debug_immutable_obj_cache": "0/5", "debug_javaclient": "1/5", "debug_journal": "1/3", "debug_journaler": "0/5", "debug_kstore": "1/5", "debug_leveldb": "4/5", "debug_lockdep": "0/1", "debug_mds": "1/5", "debug_mds_balancer": "1/5", "debug_mds_locker": "1/5", "debug_mds_log": "1/5", "debug_mds_log_expire": "1/5", "debug_mds_migrator": "1/5", "debug_memdb": "4/5", "debug_mgr": "1/5", "debug_mgrc": "1/5", "debug_mon": "20/20", "debug_monc": "0/10", "debug_ms": "1/1", "debug_none": "0/5", "debug_objclass": "0/5", "debug_objectcacher": "0/5", "debug_objecter": "0/1", "debug_optracker": "0/5", "debug_osd": "1/5", "debug_paxos": "20/20", "debug_perfcounter": "1/5", "debug_prioritycache": "1/5", "debug_rados": "0/5", "debug_rbd": "0/5", "debug_rbd_mirror": "0/5", "debug_rbd_replay": "0/5", "debug_refs": "0/0", "debug_reserver": "1/1", "debug_rgw": "1/5", "debug_rgw_sync": "1/5", "debug_rocksdb": "4/5", "debug_shell": "false", "debug_striper": "0/1", "debug_test": "0/5", "debug_throttle": "1/1", "debug_timer": "0/1", "debug_tp": "0/5", "device_failure_prediction_mode": "none", "echo": "false", "editor": "vim", "enable_experimental_unrecoverable_data_corrupting_features": "", "erasure_code_dir": "/usr/lib64/ceph/erasure-code", "err_to_graylog": "false", "err_to_stderr": "true", "err_to_syslog": "false", "event_tracing": "false", "fake_statfs_for_testing": "0", "fatal_signal_handlers": "true", "feedback_to_output": "false", "filer_max_purge_ops": "10", "filer_max_truncate_ops": "128", "filestore_apply_finisher_threads": "1", "filestore_blackhole": "false", "filestore_btrfs_clone_range": "true", "filestore_btrfs_snap": "true", "filestore_caller_concurrency": "10", "filestore_collect_device_partition_information": "true", "filestore_commit_timeout": "600.000000", "filestore_debug_inject_read_err": "false", "filestore_debug_omap_check": "false", "filestore_debug_random_read_err": "0.000000", "filestore_debug_verify_split": "false", "filestore_dump_file": "", "filestore_expected_throughput_bytes": "209715200.000000", "filestore_expected_throughput_ops": "200.000000", "filestore_fadvise": "true", "filestore_fail_eio": "true", "filestore_fd_cache_shards": "16", "filestore_fd_cache_size": "128", "filestore_fiemap": "false", "filestore_fiemap_threshold": "4096", "filestore_fsync_flushes_journal_data": "false", "filestore_index_retry_probability": "0.000000", "filestore_inject_stall": "0", "filestore_journal_parallel": "false", "filestore_journal_trailing": "false", "filestore_journal_writeahead": "false", "filestore_kill_at": "0", "filestore_max_alloc_hint_size": "1048576", "filestore_max_inline_xattr_size": "0", "filestore_max_inline_xattr_size_btrfs": "2048", "filestore_max_inline_xattr_size_other": "512", "filestore_max_inline_xattr_size_xfs": "65536", "filestore_max_inline_xattrs": "0", "filestore_max_inline_xattrs_btrfs": "10", "filestore_max_inline_xattrs_other": "2", "filestore_max_inline_xattrs_xfs": "10", "filestore_max_sync_interval": "5.000000", "filestore_max_xattr_value_size": "0", "filestore_max_xattr_value_size_btrfs": "65536", "filestore_max_xattr_value_size_other": "1024", "filestore_max_xattr_value_size_xfs": "65536", "filestore_merge_threshold": "-10", "filestore_min_sync_interval": "0.010000", "filestore_odsync_write": "false", "filestore_omap_backend": "rocksdb", "filestore_omap_backend_path": "", "filestore_omap_header_cache_size": "1024", "filestore_ondisk_finisher_threads": "1", "filestore_op_thread_suicide_timeout": "180", "filestore_op_thread_timeout": "60", "filestore_op_threads": "2", "filestore_punch_hole": "false", "filestore_queue_high_delay_multiple": "0.000000", "filestore_queue_high_delay_multiple_bytes": "0.000000", "filestore_queue_high_delay_multiple_ops": "0.000000", "filestore_queue_high_threshhold": "0.900000", "filestore_queue_low_threshhold": "0.300000", "filestore_queue_max_bytes": "104857600", "filestore_queue_max_delay_multiple": "0.000000", "filestore_queue_max_delay_multiple_bytes": "0.000000", "filestore_queue_max_delay_multiple_ops": "0.000000", "filestore_queue_max_ops": "50", "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", "filestore_seek_data_hole": "false", "filestore_sloppy_crc": "false", "filestore_sloppy_crc_block_size": "65536", "filestore_splice": "false", "filestore_split_multiple": "2", "filestore_split_rand_factor": "20", "filestore_update_to": "1000", "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", "filestore_wbthrottle_btrfs_ios_start_flusher": "500", "filestore_wbthrottle_enable": "true", "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", "filestore_wbthrottle_xfs_inodes_start_flusher": "500", "filestore_wbthrottle_xfs_ios_hard_limit": "5000", "filestore_wbthrottle_xfs_ios_start_flusher": "500", "filestore_xfs_extsize": "false", "filestore_zfs_snap": "false", "fio_dir": "/tmp/fio", "fsid": "4a02c23c-2698-11ea-8286-001a4aab830c", "fuse_allow_other": "true", "fuse_atomic_o_trunc": "true", "fuse_big_writes": "false", "fuse_debug": "false", "fuse_default_permissions": "false", "fuse_disable_pagecache": "false", "fuse_max_write": "0", "fuse_multithreaded": "true", "fuse_require_active_mds": "true", "fuse_set_user_groups": "true", "fuse_syncfs_on_mksnap": "true", "fuse_use_invalidate_cb": "true", "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", "gss_target_name": "ceph", "heartbeat_file": "", "heartbeat_inject_failure": "0", "heartbeat_interval": "5", "host": "", "immutable_object_cache_client_dedicated_thread_num": "2", "immutable_object_cache_max_inflight_ops": "128", "immutable_object_cache_max_size": "1073741824", "immutable_object_cache_path": "/tmp", "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", "immutable_object_cache_watermark": "0.100000", "inject_early_sigterm": "false", "journal_aio": "true", "journal_align_min_size": "65536", "journal_block_align": "true", "journal_block_size": "4096", "journal_dio": "true", "journal_discard": "false", "journal_force_aio": "false", "journal_ignore_corruption": "false", "journal_max_write_bytes": "10485760", "journal_max_write_entries": "100", "journal_replay_from": "0", "journal_throttle_high_multiple": "0.000000", "journal_throttle_high_threshhold": "0.900000", "journal_throttle_low_threshhold": "0.600000", "journal_throttle_max_multiple": "0.000000", "journal_write_header_frequency": "0", "journal_zero_on_create": "false", "journaler_prefetch_periods": "10", "journaler_prezero_periods": "5", "journaler_write_head_interval": "15", "key": "", "keyfile": "", "keyring": "/var/lib/ceph/mon/ceph-a/keyring", "kstore_backend": "rocksdb", "kstore_default_stripe_size": "65536", "kstore_fsck_on_mount": "false", "kstore_fsck_on_mount_deep": "true", "kstore_max_bytes": "67108864", "kstore_max_ops": "512", "kstore_nid_prealloc": "1024", "kstore_onode_map_size": "1024", "kstore_rocksdb_options": "compression=kNoCompression", "kstore_sync_submit_transaction": "false", "kstore_sync_transaction": "false", "leveldb_block_size": "65536", "leveldb_bloom_size": "0", "leveldb_cache_size": "536870912", "leveldb_compact_on_mount": "false", "leveldb_compression": "false", "leveldb_log": "", "leveldb_log_to_ceph_log": "true", "leveldb_max_open_files": "0", "leveldb_paranoid": "false", "leveldb_write_buffer_size": "33554432", "lockdep": "false", "lockdep_force_backtrace": "false", "log_coarse_timestamps": "true", "log_file": "/var/log/ceph/ceph-mon.a.log", "log_flush_on_exit": "false", "log_graylog_host": "127.0.0.1", "log_graylog_port": "12201", "log_max_new": "1000", "log_max_recent": "10000", "log_stderr_prefix": "", "log_stop_at_utilization": "0.970000", "log_to_file": "true", "log_to_graylog": "false", "log_to_stderr": "false", "log_to_syslog": "false", "max_completion_items": "50", "max_rotating_auth_attempts": "10", "mds_action_on_write_error": "1", "mds_bal_export_pin": "true", "mds_bal_fragment_dirs": "true", "mds_bal_fragment_fast_factor": "1.500000", "mds_bal_fragment_interval": "5", "mds_bal_fragment_size_max": "100000", "mds_bal_idle_threshold": "0.000000", "mds_bal_interval": "10", "mds_bal_max": "-1", "mds_bal_max_until": "-1", "mds_bal_merge_size": "50", "mds_bal_midchunk": "0.300000", "mds_bal_min_rebalance": "0.100000", "mds_bal_min_start": "0.200000", "mds_bal_minchunk": "0.001000", "mds_bal_mode": "0", "mds_bal_need_max": "1.200000", "mds_bal_need_min": "0.800000", "mds_bal_replicate_threshold": "8000.000000", "mds_bal_sample_interval": "3.000000", "mds_bal_split_bits": "3", "mds_bal_split_rd": "25000.000000", "mds_bal_split_size": "10000", "mds_bal_split_wr": "10000.000000", "mds_bal_target_decay": "10.000000", "mds_bal_unreplicate_threshold": "0.000000", "mds_beacon_grace": "15.000000", "mds_beacon_interval": "4.000000", "mds_cache_memory_limit": "4294967296", "mds_cache_mid": "0.700000", "mds_cache_release_free_interval": "10", "mds_cache_reservation": "0.050000", "mds_cache_trim_decay_rate": "1.000000", "mds_cache_trim_interval": "1", "mds_cache_trim_threshold": "65536", "mds_cap_revoke_eviction_timeout": "0.000000", "mds_client_prealloc_inos": "1000", "mds_client_writeable_range_max_inc_objs": "1024", "mds_damage_table_max_entries": "10000", "mds_data": "/var/lib/ceph/mds/ceph-a", "mds_debug_auth_pins": "false", "mds_debug_frag": "false", "mds_debug_scatterstat": "false", "mds_debug_subtrees": "false", "mds_decay_halflife": "5.000000", "mds_default_dir_hash": "2", "mds_defer_session_stale": "true", "mds_dir_keys_per_op": "16384", "mds_dir_max_commit_size": "10", "mds_dirstat_min_interval": "1.000000", "mds_dump_cache_after_rejoin": "false", "mds_dump_cache_on_map": "false", "mds_dump_cache_threshold_file": "0", "mds_dump_cache_threshold_formatter": "1073741824", "mds_early_reply": "true", "mds_enable_op_tracker": "true", "mds_enforce_unique_name": "true", "mds_freeze_tree_timeout": "30.000000", "mds_hack_allow_loading_invalid_metadata": "false", "mds_health_cache_threshold": "1.500000", "mds_health_summarize_threshold": "10", "mds_heartbeat_grace": "15.000000", "mds_inject_migrator_session_race": "false", "mds_inject_traceless_reply_probability": "0.000000", "mds_journal_format": "1", "mds_kill_create_at": "0", "mds_kill_export_at": "0", "mds_kill_import_at": "0", "mds_kill_journal_at": "0", "mds_kill_journal_expire_at": "0", "mds_kill_journal_replay_at": "0", "mds_kill_link_at": "0", "mds_kill_mdstable_at": "0", "mds_kill_openc_at": "0", "mds_kill_rename_at": "0", "mds_log_events_per_segment": "1024", "mds_log_max_events": "-1", "mds_log_max_segments": "128", "mds_log_pause": "false", "mds_log_segment_size": "0", "mds_log_skip_corrupt_events": "false", "mds_max_caps_per_client": "1048576", "mds_max_completed_flushes": "100000", "mds_max_completed_requests": "100000", "mds_max_export_size": "20971520", "mds_max_file_recover": "32", "mds_max_purge_files": "64", "mds_max_purge_ops": "8192", "mds_max_purge_ops_per_pg": "0.500000", "mds_max_retries_on_remount_failure": "5", "mds_max_scrub_ops_in_progress": "5", "mds_max_snaps_per_dir": "100", "mds_max_xattr_pairs_size": "65536", "mds_min_caps_per_client": "100", "mds_mon_shutdown_timeout": "5.000000", "mds_numa_node": "-1", "mds_op_complaint_time": "30.000000", "mds_op_history_duration": "600", "mds_op_history_size": "20", "mds_op_log_threshold": "5", "mds_purge_queue_busy_flush_period": "1.000000", "mds_recall_global_max_decay_threshold": "65536", "mds_recall_max_caps": "5000", "mds_recall_max_decay_rate": "2.500000", "mds_recall_max_decay_threshold": "16384", "mds_recall_warning_decay_rate": "60.000000", "mds_recall_warning_threshold": "32768", "mds_reconnect_timeout": "45.000000", "mds_replay_interval": "1.000000", "mds_replay_unsafe_with_closed_session": "false", "mds_request_load_average_decay_rate": "60.000000", "mds_root_ino_gid": "0", "mds_root_ino_uid": "0", "mds_scatter_nudge_interval": "5.000000", "mds_session_blacklist_on_evict": "true", "mds_session_blacklist_on_timeout": "true", "mds_session_cache_liveness_decay_rate": "300.000000", "mds_session_cache_liveness_magnitude": "10", "mds_sessionmap_keys_per_op": "1024", "mds_shutdown_check": "0", "mds_skip_ino": "0", "mds_snap_max_uid": "4294967294", "mds_snap_min_uid": "0", "mds_snap_rstat": "false", "mds_task_status_update_interval": "2.000000", "mds_thrash_exports": "0", "mds_thrash_fragments": "0", "mds_tick_interval": "5.000000", "mds_verify_backtrace": "1", "mds_verify_scatter": "false", "mds_wipe_ino_prealloc": "false", "mds_wipe_sessions": "false", "mempool_debug": "false", "memstore_debug_omit_block_device_write": "false", "memstore_device_bytes": "1073741824", "memstore_page_set": "false", "memstore_page_size": "65536", "mgr_client_bytes": "134217728", "mgr_client_messages": "512", "mgr_client_service_daemon_unregister_timeout": "1.000000", "mgr_connect_retry_interval": "1.000000", "mgr_data": "/var/lib/ceph/mgr/ceph-a", "mgr_debug_aggressive_pg_num_changes": "false", "mgr_initial_modules": "restful iostat", "mgr_mds_bytes": "134217728", "mgr_mds_messages": "128", "mgr_module_path": "/usr/share/ceph/mgr", "mgr_mon_bytes": "134217728", "mgr_mon_messages": "128", "mgr_osd_bytes": "536870912", "mgr_osd_messages": "8192", "mgr_service_beacon_grace": "60.000000", "mgr_stats_period": "5", "mgr_stats_threshold": "5", "mgr_tick_period": "2", "mon_accept_timeout_factor": "2.000000", "mon_allow_pool_delete": "true", "mon_cache_target_full_warn_ratio": "0.660000", "mon_clean_pg_upmaps_per_chunk": "256", "mon_client_bytes": "104857600", "mon_client_directed_command_retry": "5", "mon_client_hunt_interval": "3.000000", "mon_client_hunt_interval_backoff": "1.500000", "mon_client_hunt_interval_max_multiple": "10.000000", "mon_client_hunt_interval_min_multiple": "1.000000", "mon_client_hunt_parallel": "3", "mon_client_max_log_entries_per_message": "1000", "mon_client_ping_interval": "10.000000", "mon_client_ping_timeout": "30.000000", "mon_clock_drift_allowed": "1.000000", "mon_clock_drift_warn_backoff": "5.000000", "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", "mon_cluster_log_file_level": "debug", "mon_cluster_log_to_file": "true", "mon_cluster_log_to_graylog": "false", "mon_cluster_log_to_graylog_host": "127.0.0.1", "mon_cluster_log_to_graylog_port": "12201", "mon_cluster_log_to_stderr": "false", "mon_cluster_log_to_syslog": "default=false", "mon_cluster_log_to_syslog_facility": "daemon", "mon_cluster_log_to_syslog_level": "info", "mon_compact_on_bootstrap": "false", "mon_compact_on_start": "false", "mon_compact_on_trim": "true", "mon_config_key_max_entry_size": "65536", "mon_cpu_threads": "4", "mon_crush_min_required_version": "hammer", "mon_daemon_bytes": "419430400", "mon_data": "/var/lib/ceph/mon/ceph-a", "mon_data_avail_crit": "5", "mon_data_avail_warn": "5", "mon_data_size_warn": "16106127360", "mon_debug_block_osdmap_trim": "false", "mon_debug_deprecated_as_obsolete": "false", "mon_debug_dump_json": "false", "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", "mon_debug_dump_transactions": "false", "mon_debug_extra_checks": "false", "mon_debug_no_initial_persistent_features": "false", "mon_debug_no_require_bluestore_for_ec_overwrites": "false", "mon_debug_no_require_nautilus": "false", "mon_debug_no_require_octopus": "false", "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", "mon_delta_reset_interval": "10.000000", "mon_dns_srv_name": "ceph-mon", "mon_election_timeout": "5.000000", "mon_enable_op_tracker": "true", "mon_fake_pool_delete": "false", "mon_force_quorum_join": "false", "mon_globalid_prealloc": "10000", "mon_health_log_update_period": "5", "mon_health_max_detail": "50", "mon_health_to_clog": "true", "mon_health_to_clog_interval": "3600", "mon_health_to_clog_tick_interval": "60.000000", "mon_host": "[v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0]", "mon_initial_members": "", "mon_inject_pg_merge_bounce_probability": "0.000000", "mon_inject_sync_get_chunk_delay": "0.000000", "mon_inject_transaction_delay_max": "10.000000", "mon_inject_transaction_delay_probability": "0.000000", "mon_keyvaluedb": "rocksdb", "mon_lease": "5.000000", "mon_lease_ack_timeout_factor": "2.000000", "mon_lease_renew_interval_factor": "0.600000", "mon_log_max_summary": "50", "mon_max_log_entries_per_event": "4096", "mon_max_log_epochs": "500", "mon_max_mdsmap_epochs": "500", "mon_max_mgrmap_epochs": "500", "mon_max_osd": "10000", "mon_max_pg_per_osd": "10000", "mon_max_pool_pg_num": "65536", "mon_max_snap_prune_per_epoch": "100", "mon_mds_blacklist_interval": "86400.000000", "mon_mds_force_trim_to": "0", "mon_mds_skip_sanity": "false", "mon_memory_autotune": "true", "mon_memory_target": "2147483648", "mon_mgr_beacon_grace": "30", "mon_mgr_blacklist_interval": "86400.000000", "mon_mgr_digest_period": "5", "mon_mgr_inactive_grace": "60", "mon_mgr_mkfs_grace": "240", "mon_mgr_proxy_client_bytes_ratio": "0.300000", "mon_min_osdmap_epochs": "50", "mon_op_complaint_time": "30", "mon_op_history_duration": "600", "mon_op_history_size": "20", "mon_op_history_slow_op_size": "20", "mon_op_history_slow_op_threshold": "10", "mon_op_log_threshold": "5", "mon_osd_adjust_down_out_interval": "true", "mon_osd_adjust_heartbeat_grace": "true", "mon_osd_auto_mark_auto_out_in": "true", "mon_osd_auto_mark_in": "false", "mon_osd_auto_mark_new_in": "true", "mon_osd_backfillfull_ratio": "0.900000", "mon_osd_blacklist_default_expire": "3600.000000", "mon_osd_cache_size": "500", "mon_osd_cache_size_min": "134217728", "mon_osd_crush_smoke_test": "true", "mon_osd_destroyed_out_interval": "600", "mon_osd_down_out_interval": "600", "mon_osd_down_out_subtree_limit": "rack", "mon_osd_err_op_age_ratio": "128.000000", "mon_osd_force_trim_to": "0", "mon_osd_full_ratio": "0.950000", "mon_osd_initial_require_min_compat_client": "jewel", "mon_osd_laggy_halflife": "3600", "mon_osd_laggy_max_interval": "300", "mon_osd_laggy_weight": "0.300000", "mon_osd_mapping_pgs_per_chunk": "4096", "mon_osd_max_creating_pgs": "1024", "mon_osd_max_initial_pgs": "1024", "mon_osd_min_down_reporters": "2", "mon_osd_min_in_ratio": "0.750000", "mon_osd_min_up_ratio": "0.300000", "mon_osd_nearfull_ratio": "0.850000", "mon_osd_prime_pg_temp": "true", "mon_osd_prime_pg_temp_max_estimate": "0.250000", "mon_osd_prime_pg_temp_max_time": "0.500000", "mon_osd_report_timeout": "900", "mon_osd_reporter_subtree_level": "osd", "mon_osd_snap_trim_queue_warn_on": "32768", "mon_osd_warn_op_age": "32.000000", "mon_osdmap_full_prune_enabled": "true", "mon_osdmap_full_prune_interval": "2", "mon_osdmap_full_prune_min": "15", "mon_osdmap_full_prune_txsize": "2", "mon_pg_check_down_all_threshold": "0.500000", "mon_pg_stuck_threshold": "60", "mon_pg_warn_max_object_skew": "0.000000", "mon_pg_warn_min_objects": "10000", "mon_pg_warn_min_per_osd": "0", "mon_pg_warn_min_pool_objects": "1000", "mon_pool_quota_crit_threshold": "0", "mon_pool_quota_warn_threshold": "0", "mon_probe_timeout": "2.000000", "mon_reweight_max_change": "0.050000", "mon_reweight_max_osds": "4", "mon_reweight_min_bytes_per_osd": "10", "mon_reweight_min_pgs_per_osd": "4", "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", "mon_scrub_inject_crc_mismatch": "0.000000", "mon_scrub_inject_missing_keys": "0.000000", "mon_scrub_interval": "86400", "mon_scrub_max_keys": "100", "mon_scrub_timeout": "300", "mon_session_timeout": "300", "mon_smart_report_timeout": "5", "mon_stat_smooth_intervals": "6", "mon_subscribe_interval": "86400.000000", "mon_sync_debug": "false", "mon_sync_max_payload_keys": "2000", "mon_sync_max_payload_size": "1048576", "mon_sync_provider_kill_at": "0", "mon_sync_requester_kill_at": "0", "mon_sync_timeout": "60.000000", "mon_target_pg_per_osd": "100", "mon_tick_interval": "5", "mon_timecheck_interval": "300.000000", "mon_timecheck_skew_interval": "30.000000", "mon_warn_on_cache_pools_without_hit_sets": "true", "mon_warn_on_crush_straw_calc_version_zero": "false", "mon_warn_on_legacy_crush_tunables": "false", "mon_warn_on_misplaced": "false", "mon_warn_on_msgr2_not_enabled": "true", "mon_warn_on_osd_down_out_interval_zero": "false", "mon_warn_on_pool_no_app": "true", "mon_warn_on_pool_no_redundancy": "true", "mon_warn_on_pool_pg_num_not_power_of_two": "false", "mon_warn_on_slow_ping_ratio": "0.050000", "mon_warn_on_slow_ping_time": "0.000000", "mon_warn_on_too_few_osds": "false", "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", "mon_warn_pg_not_scrubbed_ratio": "0.500000", "monmap": "", "ms_async_max_op_threads": "5", "ms_async_op_threads": "3", "ms_async_rdma_buffer_size": "131072", "ms_async_rdma_cm": "false", "ms_async_rdma_device_name": "", "ms_async_rdma_dscp": "96", "ms_async_rdma_enable_hugepage": "false", "ms_async_rdma_gid_idx": "0", "ms_async_rdma_local_gid": "", "ms_async_rdma_polling_us": "1000", "ms_async_rdma_port_num": "1", "ms_async_rdma_receive_buffers": "32768", "ms_async_rdma_receive_queue_len": "4096", "ms_async_rdma_roce_ver": "1", "ms_async_rdma_send_buffers": "1024", "ms_async_rdma_sl": "3", "ms_async_rdma_support_srq": "true", "ms_async_rdma_type": "ib", "ms_bind_before_connect": "false", "ms_bind_ipv4": "true", "ms_bind_ipv6": "false", "ms_bind_msgr1": "true", "ms_bind_msgr2": "true", "ms_bind_port_max": "7300", "ms_bind_port_min": "6800", "ms_bind_prefer_ipv4": "false", "ms_bind_retry_count": "3", "ms_bind_retry_delay": "5", "ms_blackhole_client": "false", "ms_blackhole_mds": "false", "ms_blackhole_mgr": "false", "ms_blackhole_mon": "false", "ms_blackhole_osd": "false", "ms_client_mode": "crc secure", "ms_cluster_mode": "crc secure", "ms_cluster_type": "", "ms_connection_idle_timeout": "900", "ms_connection_ready_timeout": "10", "ms_crc_data": "true", "ms_crc_header": "true", "ms_die_on_bad_msg": "false", "ms_die_on_bug": "true", "ms_die_on_old_message": "true", "ms_die_on_skipped_message": "false", "ms_die_on_unhandled_msg": "false", "ms_dispatch_throttle_bytes": "104857600", "ms_dpdk_coremask": "0xF", "ms_dpdk_debug_allow_loopback": "false", "ms_dpdk_gateway_ipv4_addr": "", "ms_dpdk_host_ipv4_addr": "", "ms_dpdk_hugepages": "", "ms_dpdk_hw_flow_control": "true", "ms_dpdk_hw_queue_weight": "1.000000", "ms_dpdk_lro": "true", "ms_dpdk_memory_channel": "4", "ms_dpdk_netmask_ipv4_addr": "", "ms_dpdk_pmd": "", "ms_dpdk_port_id": "0", "ms_dpdk_rx_buffer_count_per_core": "8192", "ms_dump_corrupt_message_level": "1", "ms_dump_on_send": "false", "ms_initial_backoff": "0.200000", "ms_inject_delay_max": "1.000000", "ms_inject_delay_msg_type": "", "ms_inject_delay_probability": "0.000000", "ms_inject_delay_type": "", "ms_inject_internal_delays": "0.000000", "ms_inject_socket_failures": "2500", "ms_learn_addr_from_peer": "true", "ms_max_accept_failures": "4", "ms_max_backoff": "15.000000", "ms_mon_client_mode": "secure crc", "ms_mon_cluster_mode": "secure crc", "ms_mon_service_mode": "secure crc", "ms_pq_max_tokens_per_priority": "16777216", "ms_pq_min_cost": "65536", "ms_public_type": "", "ms_service_mode": "crc secure", "ms_tcp_listen_backlog": "512", "ms_tcp_nodelay": "true", "ms_tcp_prefetch_max_size": "4096", "ms_tcp_rcvbuf": "0", "ms_type": "async+posix", "no_config_file": "false", "objecter_completion_locks_per_session": "32", "objecter_debug_inject_relock_delay": "false", "objecter_inflight_op_bytes": "104857600", "objecter_inflight_ops": "1024", "objecter_inject_no_watch_ping": "false", "objecter_retry_writes_after_first_reply": "false", "objecter_tick_interval": "5.000000", "objecter_timeout": "10.000000", "objectstore_blackhole": "false", "osd_agent_delay_time": "5.000000", "osd_agent_hist_halflife": "1000", "osd_agent_max_low_ops": "2", "osd_agent_max_ops": "4", "osd_agent_min_evict_effort": "0.100000", "osd_agent_quantize_effort": "0.100000", "osd_agent_slop": "0.020000", "osd_allow_recovery_below_min_size": "true", "osd_async_recovery_min_cost": "100", "osd_auto_mark_unfound_lost": "false", "osd_backfill_retry_interval": "30.000000", "osd_backfill_scan_max": "512", "osd_backfill_scan_min": "64", "osd_backoff_on_degraded": "false", "osd_backoff_on_peering": "false", "osd_backoff_on_unfound": "true", "osd_beacon_report_interval": "300", "osd_bench_duration": "30", "osd_bench_large_size_max_throughput": "104857600", "osd_bench_max_block_size": "67108864", "osd_bench_small_size_max_iops": "100", "osd_blkin_trace_all": "false", "osd_calc_pg_upmaps_aggressively": "true", "osd_calc_pg_upmaps_local_fallback_retries": "100", "osd_check_for_log_corruption": "false", "osd_check_max_object_name_len_on_startup": "true", "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas", "osd_class_dir": "/usr/lib64/rados-classes", "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas", "osd_class_update_on_start": "true", "osd_client_message_cap": "100", "osd_client_message_size_cap": "524288000", "osd_client_op_priority": "63", "osd_client_watch_timeout": "30", "osd_command_max_records": "256", "osd_command_thread_suicide_timeout": "900", "osd_command_thread_timeout": "600", "osd_copyfrom_max_chunk": "8388608", "osd_crush_chooseleaf_type": "1", "osd_crush_initial_weight": "-1.000000", "osd_crush_update_on_start": "true", "osd_crush_update_weight_set": "true", "osd_data": "/var/lib/ceph/osd/ceph-a", "osd_debug_crash_on_ignored_backoff": "false", "osd_debug_deep_scrub_sleep": "0.000000", "osd_debug_drop_ping_duration": "0", "osd_debug_drop_ping_probability": "0.000000", "osd_debug_feed_pullee": "-1", "osd_debug_inject_copyfrom_error": "false", "osd_debug_inject_dispatch_delay_duration": "0.100000", "osd_debug_inject_dispatch_delay_probability": "0.000000", "osd_debug_misdirected_ops": "false", "osd_debug_no_acting_change": "false", "osd_debug_no_purge_strays": "false", "osd_debug_op_order": "false", "osd_debug_pg_log_writeout": "false", "osd_debug_pretend_recovery_active": "false", "osd_debug_random_push_read_error": "0.000000", "osd_debug_reject_backfill_probability": "0.000000", "osd_debug_shutdown": "false", "osd_debug_skip_full_check_in_backfill_reservation": "false", "osd_debug_skip_full_check_in_recovery": "false", "osd_debug_verify_cached_snaps": "false", "osd_debug_verify_missing_on_start": "false", "osd_debug_verify_snaps": "false", "osd_debug_verify_stray_on_activate": "false", "osd_deep_scrub_interval": "604800.000000", "osd_deep_scrub_keys": "1024", "osd_deep_scrub_large_omap_object_key_threshold": "200000", "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", "osd_deep_scrub_randomize_ratio": "0.150000", "osd_deep_scrub_stride": "524288", "osd_deep_scrub_update_digest_min_age": "7200", "osd_default_data_pool_replay_window": "45", "osd_default_notify_timeout": "30", "osd_delete_sleep": "0.000000", "osd_delete_sleep_hdd": "5.000000", "osd_delete_sleep_hybrid": "2.000000", "osd_delete_sleep_ssd": "0.000000", "osd_discard_disconnected_ops": "true", "osd_enable_op_tracker": "true", "osd_erasure_code_plugins": "jerasure lrc isa", "osd_failsafe_full_ratio": "0.970000", "osd_fast_fail_on_connection_refused": "true", "osd_fast_info": "true", "osd_fast_shutdown": "true", "osd_find_best_info_ignore_history_les": "false", "osd_force_auth_primary_missing_objects": "100", "osd_force_recovery_pg_log_entries_factor": "1.300000", "osd_function_tracing": "false", "osd_heartbeat_grace": "20", "osd_heartbeat_interval": "6", "osd_heartbeat_min_healthy_ratio": "0.330000", "osd_heartbeat_min_peers": "10", "osd_heartbeat_min_size": "2000", "osd_heartbeat_stale": "600", "osd_heartbeat_use_min_delay_socket": "false", "osd_hit_set_max_size": "100000", "osd_hit_set_min_size": "1000", "osd_hit_set_namespace": ".ceph-internal", "osd_ignore_stale_divergent_priors": "false", "osd_inject_bad_map_crc_probability": "0.000000", "osd_inject_failure_on_pg_removal": "false", "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", "osd_journal_flush_on_shutdown": "true", "osd_journal_size": "5120", "osd_kill_backfill_at": "0", "osd_loop_before_reset_tphandle": "64", "osd_map_cache_size": "50", "osd_map_dedup": "true", "osd_map_message_max": "40", "osd_map_message_max_bytes": "10485760", "osd_map_share_max_epochs": "40", "osd_max_attr_name_len": "100", "osd_max_attr_size": "0", "osd_max_backfills": "1", "osd_max_markdown_count": "5", "osd_max_markdown_period": "600", "osd_max_object_name_len": "2048", "osd_max_object_namespace_len": "256", "osd_max_object_size": "134217728", "osd_max_omap_bytes_per_request": "1073741824", "osd_max_omap_entries_per_request": "1024", "osd_max_pg_blocked_by": "16", "osd_max_pg_log_entries": "3000", "osd_max_pg_per_osd_hard_ratio": "3.000000", "osd_max_pgls": "1024", "osd_max_push_cost": "8388608", "osd_max_push_objects": "10", "osd_max_scrubs": "1", "osd_max_snap_prune_intervals_per_epoch": "512", "osd_max_trimming_pgs": "2", "osd_max_write_op_reply_len": "32", "osd_max_write_size": "90", "osd_mclock_scheduler_anticipation_timeout": "0.000000", "osd_mclock_scheduler_background_best_effort_lim": "999999", "osd_mclock_scheduler_background_best_effort_res": "1", "osd_mclock_scheduler_background_best_effort_wgt": "1", "osd_mclock_scheduler_background_recovery_lim": "999999", "osd_mclock_scheduler_background_recovery_res": "1", "osd_mclock_scheduler_background_recovery_wgt": "1", "osd_mclock_scheduler_client_lim": "999999", "osd_mclock_scheduler_client_res": "1", "osd_mclock_scheduler_client_wgt": "1", "osd_memory_base": "805306368", "osd_memory_cache_min": "134217728", "osd_memory_cache_resize_interval": "1.000000", "osd_memory_expected_fragmentation": "0.150000", "osd_memory_target": "4294967296", "osd_memory_target_cgroup_limit_ratio": "0.800000", "osd_min_pg_log_entries": "3000", "osd_min_recovery_priority": "0", "osd_mon_ack_timeout": "30.000000", "osd_mon_heartbeat_interval": "30", "osd_mon_heartbeat_stat_stale": "3600", "osd_mon_report_interval": "5", "osd_mon_report_max_in_flight": "2", "osd_mon_shutdown_timeout": "5.000000", "osd_num_cache_shards": "32", "osd_num_op_tracker_shard": "32", "osd_numa_auto_affinity": "true", "osd_numa_node": "-1", "osd_numa_prefer_iface": "true", "osd_object_clean_region_max_num_intervals": "10", "osd_objecter_finishers": "1", "osd_objectstore": "bluestore", "osd_objectstore_fuse": "false", "osd_objectstore_tracing": "false", "osd_op_complaint_time": "30.000000", "osd_op_history_duration": "600", "osd_op_history_size": "20", "osd_op_history_slow_op_size": "20", "osd_op_history_slow_op_threshold": "10.000000", "osd_op_log_threshold": "5", "osd_op_num_shards": "0", "osd_op_num_shards_hdd": "5", "osd_op_num_shards_ssd": "8", "osd_op_num_threads_per_shard": "0", "osd_op_num_threads_per_shard_hdd": "1", "osd_op_num_threads_per_shard_ssd": "2", "osd_op_pq_max_tokens_per_priority": "4194304", "osd_op_pq_min_cost": "65536", "osd_op_queue": "wpq", "osd_op_queue_cut_off": "high", "osd_op_thread_suicide_timeout": "150", "osd_op_thread_timeout": "15", "osd_open_classes_on_start": "true", "osd_os_flags": "0", "osd_peering_op_priority": "255", "osd_pg_delete_cost": "1048576", "osd_pg_delete_priority": "5", "osd_pg_epoch_max_lag_factor": "2.000000", "osd_pg_epoch_persisted_max_stale": "40", "osd_pg_log_dups_tracked": "3000", "osd_pg_log_trim_max": "10000", "osd_pg_log_trim_min": "100", "osd_pg_max_concurrent_snap_trims": "2", "osd_pg_object_context_cache_count": "64", "osd_pg_stat_report_interval_max": "500", "osd_pool_default_cache_max_evict_check_size": "10", "osd_pool_default_cache_min_evict_age": "0", "osd_pool_default_cache_min_flush_age": "0", "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", "osd_pool_default_cache_target_dirty_ratio": "0.400000", "osd_pool_default_cache_target_full_ratio": "0.800000", "osd_pool_default_crush_rule": "-1", "osd_pool_default_ec_fast_read": "false", "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd", "osd_pool_default_flag_hashpspool": "true", "osd_pool_default_flag_nodelete": "false", "osd_pool_default_flag_nopgchange": "false", "osd_pool_default_flag_nosizechange": "false", "osd_pool_default_flags": "0", "osd_pool_default_hit_set_bloom_fpp": "0.050000", "osd_pool_default_min_size": "2", "osd_pool_default_pg_autoscale_mode": "off", "osd_pool_default_pg_num": "16", "osd_pool_default_pgp_num": "0", "osd_pool_default_read_lease_ratio": "0.800000", "osd_pool_default_size": "3", "osd_pool_default_type": "replicated", "osd_pool_erasure_code_stripe_unit": "4096", "osd_pool_use_gmt_hitset": "true", "osd_push_per_object_cost": "1000", "osd_read_ec_check_for_errors": "false", "osd_recover_clone_overlap": "true", "osd_recover_clone_overlap_limit": "10", "osd_recovery_cost": "20971520", "osd_recovery_delay_start": "0.000000", "osd_recovery_max_active": "0", "osd_recovery_max_active_hdd": "3", "osd_recovery_max_active_ssd": "10", "osd_recovery_max_chunk": "8388608", "osd_recovery_max_omap_entries_per_chunk": "8096", "osd_recovery_max_single_start": "1", "osd_recovery_op_priority": "3", "osd_recovery_op_warn_multiple": "16", "osd_recovery_priority": "5", "osd_recovery_retry_interval": "30.000000", "osd_recovery_sleep": "0.000000", "osd_recovery_sleep_hdd": "0.100000", "osd_recovery_sleep_hybrid": "0.025000", "osd_recovery_sleep_ssd": "0.000000", "osd_repair_during_recovery": "false", "osd_requested_scrub_priority": "120", "osd_rollback_to_cluster_snap": "", "osd_scrub_auto_repair": "false", "osd_scrub_auto_repair_num_errors": "5", "osd_scrub_backoff_ratio": "0.660000", "osd_scrub_begin_hour": "0", "osd_scrub_begin_week_day": "0", "osd_scrub_chunk_max": "25", "osd_scrub_chunk_min": "5", "osd_scrub_cost": "52428800", "osd_scrub_during_recovery": "false", "osd_scrub_end_hour": "24", "osd_scrub_end_week_day": "7", "osd_scrub_extended_sleep": "0.000000", "osd_scrub_interval_randomize_ratio": "0.500000", "osd_scrub_invalid_stats": "true", "osd_scrub_load_threshold": "0.500000", "osd_scrub_max_interval": "604800.000000", "osd_scrub_max_preemptions": "5", "osd_scrub_min_interval": "86400.000000", "osd_scrub_priority": "5", "osd_scrub_sleep": "0.000000", "osd_shutdown_pgref_assert": "false", "osd_skip_data_digest": "false", "osd_smart_report_timeout": "5", "osd_snap_trim_cost": "1048576", "osd_snap_trim_priority": "5", "osd_snap_trim_sleep": "0.000000", "osd_snap_trim_sleep_hdd": "5.000000", "osd_snap_trim_sleep_hybrid": "2.000000", "osd_snap_trim_sleep_ssd": "0.000000", "osd_stats_ack_timeout_decay": "0.900000", "osd_stats_ack_timeout_factor": "2.000000", "osd_target_transaction_size": "30", "osd_tier_default_cache_hit_set_count": "4", "osd_tier_default_cache_hit_set_grade_decay_rate": "20", "osd_tier_default_cache_hit_set_period": "1200", "osd_tier_default_cache_hit_set_search_last_n": "1", "osd_tier_default_cache_hit_set_type": "bloom", "osd_tier_default_cache_min_read_recency_for_promote": "1", "osd_tier_default_cache_min_write_recency_for_promote": "1", "osd_tier_default_cache_mode": "writeback", "osd_tier_promote_max_bytes_sec": "5242880", "osd_tier_promote_max_objects_sec": "25", "osd_tracing": "false", "osd_use_stale_snap": "false", "osd_uuid": "00000000-0000-0000-0000-000000000000", "osdc_blkin_trace_all": "false", "paxos_kill_at": "0", "paxos_max_join_drift": "10", "paxos_min": "500", "paxos_min_wait": "0.050000", "paxos_propose_interval": "1.000000", "paxos_service_trim_max": "500", "paxos_service_trim_min": "10", "paxos_stash_full_interval": "25", "paxos_trim_max": "500", "paxos_trim_min": "250", "perf": "true", "pid_file": "", "plugin_crypto_accelerator": "crypto_isal", "plugin_dir": "/usr/lib64/ceph", "prompt": "\u001b[01;33mCephFS:~\u001b[96m/\u001b[0m\u001b[01;33m>>>\u001b[00m ", "public_addr": "-", "public_addrv": "", "public_bind_addr": "-", "public_network": "", "public_network_interface": "", "qat_compressor_enabled": "false", "quiet": "false", "rados_mon_op_timeout": "0.000000", "rados_osd_op_timeout": "0.000000", "rados_tracing": "false", "rbd_atime_update_interval": "60", "rbd_auto_exclusive_lock_until_manual_request": "true", "rbd_balance_parent_reads": "false", "rbd_balance_snap_reads": "false", "rbd_blacklist_expire_seconds": "0", "rbd_blacklist_on_break_lock": "true", "rbd_blkin_trace_all": "false", "rbd_cache": "true", "rbd_cache_block_writes_upfront": "false", "rbd_cache_max_dirty": "25165824", "rbd_cache_max_dirty_age": "1.000000", "rbd_cache_max_dirty_object": "0", "rbd_cache_policy": "writearound", "rbd_cache_size": "33554432", "rbd_cache_target_dirty": "16777216", "rbd_cache_writethrough_until_flush": "true", "rbd_clone_copy_on_read": "false", "rbd_concurrent_management_ops": "10", "rbd_default_clone_format": "auto", "rbd_default_data_pool": "", "rbd_default_features": "61", "rbd_default_format": "2", "rbd_default_map_options": "", "rbd_default_order": "22", "rbd_default_pool": "rbd", "rbd_default_stripe_count": "0", "rbd_default_stripe_unit": "0", "rbd_disable_zero_copy_writes": "true", "rbd_discard_granularity_bytes": "65536", "rbd_discard_on_zeroed_write_same": "true", "rbd_enable_alloc_hint": "true", "rbd_io_scheduler": "simple", "rbd_io_scheduler_simple_max_delay": "0", "rbd_journal_commit_age": "5.000000", "rbd_journal_max_concurrent_object_sets": "0", "rbd_journal_max_payload_bytes": "16384", "rbd_journal_object_flush_age": "0.000000", "rbd_journal_object_flush_bytes": "1048576", "rbd_journal_object_flush_interval": "0", "rbd_journal_object_max_in_flight_appends": "0", "rbd_journal_object_writethrough_until_flush": "true", "rbd_journal_order": "24", "rbd_journal_pool": "", "rbd_journal_splay_width": "4", "rbd_localize_parent_reads": "false", "rbd_localize_snap_reads": "false", "rbd_mirror_concurrent_image_deletions": "1", "rbd_mirror_concurrent_image_syncs": "5", "rbd_mirror_delete_retry_interval": "30.000000", "rbd_mirror_image_perf_stats_prio": "5", "rbd_mirror_image_policy_migration_throttle": "300", "rbd_mirror_image_policy_rebalance_timeout": "0.000000", "rbd_mirror_image_policy_type": "simple", "rbd_mirror_image_policy_update_throttle_interval": "1.000000", "rbd_mirror_image_state_check_interval": "30", "rbd_mirror_journal_commit_age": "5.000000", "rbd_mirror_journal_poll_age": "5.000000", "rbd_mirror_leader_heartbeat_interval": "5", "rbd_mirror_leader_max_acquire_attempts_before_break": "3", "rbd_mirror_leader_max_missed_heartbeats": "2", "rbd_mirror_memory_autotune": "true", "rbd_mirror_memory_base": "805306368", "rbd_mirror_memory_cache_autotune_interval": "30.000000", "rbd_mirror_memory_cache_min": "134217728", "rbd_mirror_memory_cache_resize_interval": "5.000000", "rbd_mirror_memory_expected_fragmentation": "0.150000", "rbd_mirror_memory_target": "4294967296", "rbd_mirror_perf_stats_prio": "5", "rbd_mirror_pool_replayers_refresh_interval": "30", "rbd_mirror_sync_point_update_age": "30.000000", "rbd_mirroring_delete_delay": "0", "rbd_mirroring_max_mirroring_snapshots": "3", "rbd_mirroring_replay_delay": "0", "rbd_mirroring_resync_after_disconnect": "false", "rbd_move_parent_to_trash_on_remove": "false", "rbd_move_to_trash_on_remove": "false", "rbd_move_to_trash_on_remove_expire_seconds": "0", "rbd_mtime_update_interval": "60", "rbd_non_blocking_aio": "true", "rbd_op_thread_timeout": "60", "rbd_op_threads": "1", "rbd_parent_cache_enabled": "false", "rbd_qos_bps_burst": "0", "rbd_qos_bps_limit": "0", "rbd_qos_iops_burst": "0", "rbd_qos_iops_limit": "0", "rbd_qos_read_bps_burst": "0", "rbd_qos_read_bps_limit": "0", "rbd_qos_read_iops_burst": "0", "rbd_qos_read_iops_limit": "0", "rbd_qos_schedule_tick_min": "50", "rbd_qos_write_bps_burst": "0", "rbd_qos_write_bps_limit": "0", "rbd_qos_write_iops_burst": "0", "rbd_qos_write_iops_limit": "0", "rbd_readahead_disable_after_bytes": "52428800", "rbd_readahead_max_bytes": "524288", "rbd_readahead_trigger_requests": "10", "rbd_request_timed_out_seconds": "30", "rbd_rwl_enabled": "false", "rbd_rwl_log_periodic_stats": "false", "rbd_rwl_path": "/tmp", "rbd_rwl_size": "1073741824", "rbd_skip_partial_discard": "true", "rbd_sparse_read_threshold_bytes": "65536", "rbd_tracing": "false", "rbd_validate_names": "true", "rbd_validate_pool": "true", "restapi_base_url": "", "restapi_log_level": "", "rgw_acl_grants_max_num": "100", "rgw_admin_entry": "admin", "rgw_barbican_url": "", "rgw_bucket_default_quota_max_objects": "-1", "rgw_bucket_default_quota_max_size": "-1", "rgw_bucket_index_max_aio": "128", "rgw_bucket_quota_cache_size": "10000", "rgw_bucket_quota_soft_threshold": "0.950000", "rgw_bucket_quota_ttl": "600", "rgw_cache_enabled": "true", "rgw_cache_expiry_interval": "900", "rgw_cache_lru_size": "10000", "rgw_content_length_compat": "false", "rgw_copy_obj_progress": "true", "rgw_copy_obj_progress_every_bytes": "1048576", "rgw_cors_rules_max_num": "100", "rgw_cross_domain_policy": "", "rgw_crypt_default_encryption_key": "", "rgw_crypt_require_ssl": "true", "rgw_crypt_s3_kms_backend": "barbican", "rgw_crypt_s3_kms_encryption_keys": "", "rgw_crypt_suppress_logs": "true", "rgw_crypt_vault_addr": "", "rgw_crypt_vault_auth": "token", "rgw_crypt_vault_namespace": "", "rgw_crypt_vault_prefix": "", "rgw_crypt_vault_secret_engine": "transit", "rgw_crypt_vault_token_file": "", "rgw_curl_low_speed_limit": "1024", "rgw_curl_low_speed_time": "300", "rgw_curl_wait_timeout_ms": "1000", "rgw_data": "/var/lib/ceph/radosgw/ceph-a", "rgw_data_log_changes_size": "1000", "rgw_data_log_num_shards": "128", "rgw_data_log_obj_prefix": "data_log", "rgw_data_log_window": "30", "rgw_data_notify_interval_msec": "200", "rgw_default_realm_info_oid": "default.realm", "rgw_default_region_info_oid": "default.region", "rgw_default_zone_info_oid": "default.zone", "rgw_default_zonegroup_info_oid": "default.zonegroup", "rgw_defer_to_bucket_acls": "", "rgw_delete_multi_obj_max_num": "1000", "rgw_dmclock_admin_lim": "0.000000", "rgw_dmclock_admin_res": "100.000000", "rgw_dmclock_admin_wgt": "100.000000", "rgw_dmclock_auth_lim": "0.000000", "rgw_dmclock_auth_res": "200.000000", "rgw_dmclock_auth_wgt": "100.000000", "rgw_dmclock_data_lim": "0.000000", "rgw_dmclock_data_res": "500.000000", "rgw_dmclock_data_wgt": "500.000000", "rgw_dmclock_metadata_lim": "0.000000", "rgw_dmclock_metadata_res": "500.000000", "rgw_dmclock_metadata_wgt": "500.000000", "rgw_dns_name": "", "rgw_dns_s3website_name": "", "rgw_dynamic_resharding": "true", "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, pubsub", "rgw_enable_gc_threads": "true", "rgw_enable_lc_threads": "true", "rgw_enable_ops_log": "false", "rgw_enable_quota_threads": "true", "rgw_enable_static_website": "false", "rgw_enable_usage_log": "false", "rgw_enforce_swift_acls": "true", "rgw_exit_timeout_secs": "120", "rgw_expose_bucket": "false", "rgw_extended_http_attrs": "", "rgw_fcgi_socket_backlog": "1024", "rgw_frontends": "beast port=7480", "rgw_gc_max_concurrent_io": "10", "rgw_gc_max_deferred": "50", "rgw_gc_max_deferred_entries_size": "3072", "rgw_gc_max_objs": "32", "rgw_gc_max_queue_size": "134213632", "rgw_gc_max_trim_chunk": "16", "rgw_gc_obj_min_wait": "7200", "rgw_gc_processor_max_time": "3600", "rgw_gc_processor_period": "3600", "rgw_get_obj_max_req_size": "4194304", "rgw_get_obj_window_size": "16777216", "rgw_healthcheck_disabling_path": "", "rgw_host": "", "rgw_ignore_get_invalid_range": "false", "rgw_init_timeout": "300", "rgw_inject_notify_timeout_probability": "0.000000", "rgw_keystone_accepted_admin_roles": "", "rgw_keystone_accepted_roles": "Member, admin", "rgw_keystone_admin_domain": "", "rgw_keystone_admin_password": "", "rgw_keystone_admin_password_path": "", "rgw_keystone_admin_project": "", "rgw_keystone_admin_tenant": "", "rgw_keystone_admin_token": "", "rgw_keystone_admin_token_path": "", "rgw_keystone_admin_user": "", "rgw_keystone_api_version": "2", "rgw_keystone_barbican_domain": "", "rgw_keystone_barbican_password": "", "rgw_keystone_barbican_project": "", "rgw_keystone_barbican_tenant": "", "rgw_keystone_barbican_user": "", "rgw_keystone_implicit_tenants": "false", "rgw_keystone_token_cache_size": "10000", "rgw_keystone_url": "", "rgw_keystone_verify_ssl": "true", "rgw_lc_debug_interval": "-1", "rgw_lc_lock_max_time": "60", "rgw_lc_max_objs": "32", "rgw_lc_max_rules": "1000", "rgw_lc_thread_delay": "0", "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", "rgw_ldap_dnattr": "uid", "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", "rgw_ldap_searchfilter": "", "rgw_ldap_secret": "/etc/openldap/secret", "rgw_ldap_uri": "ldaps://", "rgw_lifecycle_work_time": "00:00-06:00", "rgw_list_bucket_min_readahead": "1000", "rgw_list_buckets_max_chunk": "1000", "rgw_log_http_headers": "", "rgw_log_nonexistent_bucket": "false", "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", "rgw_log_object_name_utc": "false", "rgw_max_attr_name_len": "0", "rgw_max_attr_size": "0", "rgw_max_attrs_num_in_req": "0", "rgw_max_chunk_size": "4194304", "rgw_max_concurrent_requests": "1024", "rgw_max_dynamic_shards": "1999", "rgw_max_listing_results": "1000", "rgw_max_notify_retries": "3", "rgw_max_objs_per_shard": "100000", "rgw_max_put_param_size": "1048576", "rgw_max_put_size": "5368709120", "rgw_max_slo_entries": "1000", "rgw_md_log_max_shards": "64", "rgw_md_notify_interval_msec": "200", "rgw_mime_types_file": "/etc/mime.types", "rgw_mp_lock_max_time": "600", "rgw_multipart_min_part_size": "5242880", "rgw_multipart_part_upload_limit": "10000", "rgw_nfs_fhcache_partitions": "3", "rgw_nfs_fhcache_size": "2017", "rgw_nfs_lru_lane_hiwat": "911", "rgw_nfs_lru_lanes": "5", "rgw_nfs_max_gc": "300", "rgw_nfs_namespace_expire_secs": "300", "rgw_nfs_s3_fast_attrs": "false", "rgw_nfs_write_completion_interval_s": "10", "rgw_num_async_rados_threads": "32", "rgw_num_control_oids": "8", "rgw_num_rados_handles": "1", "rgw_obj_stripe_size": "4194304", "rgw_obj_tombstone_cache_size": "1000", "rgw_objexp_chunk_size": "100", "rgw_objexp_gc_interval": "600", "rgw_objexp_hints_num_shards": "127", "rgw_olh_pending_timeout_sec": "3600", "rgw_op_thread_suicide_timeout": "0", "rgw_op_thread_timeout": "600", "rgw_op_tracing": "false", "rgw_opa_token": "", "rgw_opa_url": "", "rgw_opa_verify_ssl": "true", "rgw_ops_log_data_backlog": "5242880", "rgw_ops_log_rados": "true", "rgw_ops_log_socket_path": "", "rgw_override_bucket_index_max_shards": "0", "rgw_period_latest_epoch_info_oid": ".latest_epoch", "rgw_period_push_interval": "2.000000", "rgw_period_push_interval_max": "30.000000", "rgw_period_root_pool": ".rgw.root", "rgw_port": "", "rgw_print_continue": "true", "rgw_print_prohibited_content_length": "false", "rgw_put_obj_max_window_size": "67108864", "rgw_put_obj_min_window_size": "16777216", "rgw_rados_pool_autoscale_bias": "4.000000", "rgw_rados_pool_pg_num_min": "8", "rgw_rados_pool_recovery_priority": "5", "rgw_rados_tracing": "false", "rgw_realm": "", "rgw_realm_root_pool": ".rgw.root", "rgw_region": "", "rgw_region_root_pool": ".rgw.root", "rgw_relaxed_region_enforcement": "false", "rgw_relaxed_s3_bucket_names": "false", "rgw_remote_addr_param": "REMOTE_ADDR", "rgw_request_uri": "", "rgw_reshard_batch_size": "64", "rgw_reshard_bucket_lock_duration": "360", "rgw_reshard_max_aio": "128", "rgw_reshard_num_logs": "16", "rgw_reshard_thread_interval": "600", "rgw_resolve_cname": "false", "rgw_rest_getusage_op_compat": "false", "rgw_run_sync_thread": "true", "rgw_s3_auth_order": "sts, external, local", "rgw_s3_auth_use_keystone": "false", "rgw_s3_auth_use_ldap": "false", "rgw_s3_auth_use_rados": "true", "rgw_s3_auth_use_sts": "false", "rgw_s3_success_create_obj_status": "0", "rgw_safe_max_objects_per_shard": "102400", "rgw_scheduler_type": "throttler", "rgw_script_uri": "", "rgw_service_provider_name": "", "rgw_shard_warning_threshold": "90.000000", "rgw_socket_path": "", "rgw_sts_client_id": "", "rgw_sts_client_secret": "", "rgw_sts_entry": "sts", "rgw_sts_key": "sts", "rgw_sts_max_session_duration": "43200", "rgw_sts_token_introspection_url": "", "rgw_swift_account_in_url": "false", "rgw_swift_auth_entry": "auth", "rgw_swift_auth_url": "", "rgw_swift_custom_header": "", "rgw_swift_enforce_content_length": "false", "rgw_swift_need_stats": "true", "rgw_swift_tenant_name": "", "rgw_swift_token_expiration": "86400", "rgw_swift_url": "", "rgw_swift_url_prefix": "swift", "rgw_swift_versioning_enabled": "false", "rgw_sync_data_inject_err_probability": "0.000000", "rgw_sync_lease_period": "120", "rgw_sync_log_trim_concurrent_buckets": "4", "rgw_sync_log_trim_interval": "1200", "rgw_sync_log_trim_max_buckets": "16", "rgw_sync_log_trim_min_cold_buckets": "4", "rgw_sync_meta_inject_err_probability": "0.000000", "rgw_sync_trace_history_size": "4096", "rgw_sync_trace_per_node_log_size": "32", "rgw_sync_trace_servicemap_update_interval": "10", "rgw_thread_pool_size": "512", "rgw_torrent_comment": "", "rgw_torrent_createby": "", "rgw_torrent_encoding": "", "rgw_torrent_flag": "false", "rgw_torrent_origin": "", "rgw_torrent_sha_unit": "524288", "rgw_torrent_tracker": "", "rgw_trust_forwarded_https": "false", "rgw_usage_log_flush_threshold": "1024", "rgw_usage_log_tick_interval": "30", "rgw_usage_max_shards": "32", "rgw_usage_max_user_shards": "1", "rgw_use_opa_authz": "false", "rgw_user_default_quota_max_objects": "-1", "rgw_user_default_quota_max_size": "-1", "rgw_user_max_buckets": "1000", "rgw_user_quota_bucket_sync_interval": "180", "rgw_user_quota_sync_idle_users": "false", "rgw_user_quota_sync_interval": "86400", "rgw_user_quota_sync_wait_time": "86400", "rgw_user_unique_email": "true", "rgw_verify_ssl": "true", "rgw_website_routing_rules_max_num": "50", "rgw_zone": "", "rgw_zone_root_pool": ".rgw.root", "rgw_zonegroup": "", "rgw_zonegroup_root_pool": ".rgw.root", "rocksdb_block_size": "4096", "rocksdb_bloom_bits_per_key": "20", "rocksdb_cache_index_and_filter_blocks": "true", "rocksdb_cache_index_and_filter_blocks_with_high_priority": "true", "rocksdb_cache_row_ratio": "0.000000", "rocksdb_cache_shard_bits": "4", "rocksdb_cache_size": "536870912", "rocksdb_cache_type": "binned_lru", "rocksdb_collect_compaction_stats": "false", "rocksdb_collect_extended_stats": "false", "rocksdb_collect_memory_stats": "false", "rocksdb_delete_range_threshold": "1024", "rocksdb_index_type": "binary_search", "rocksdb_log_to_ceph_log": "true", "rocksdb_metadata_block_size": "4096", "rocksdb_partition_filters": "false", "rocksdb_perf": "false", "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", "rotating_keys_bootstrap_timeout": "30", "rotating_keys_renewal_timeout": "10", "run_dir": "/var/run/ceph", "setgroup": "ceph", "setuser": "ceph", "setuser_match_path": "", "target_max_misplaced_ratio": "0.050000", "thp": "false", "threadpool_default_timeout": "60", "threadpool_empty_queue_max_wait": "2", "throttler_perf_counter": "true", "timing": "false" } 2019-12-24T22:06:35.742 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2019-12-24T22:06:37.861 INFO:teuthology.orchestra.run.smithi037.stdout:mon.a: {} 2019-12-24T22:06:37.883 INFO:teuthology.orchestra.run.smithi037.stdout:mon.b: {} 2019-12-24T22:06:37.905 INFO:teuthology.orchestra.run.smithi037.stdout:mon.c: {} 2019-12-24T22:06:37.908 INFO:teuthology.orchestra.run.smithi037.stderr:mon.a: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2019-12-24T22:06:37.908 INFO:teuthology.orchestra.run.smithi037.stderr:mon.b: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2019-12-24T22:06:37.908 INFO:teuthology.orchestra.run.smithi037.stderr:mon.c: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2019-12-24T22:06:38.449 INFO:teuthology.run_tasks:Running task full_sequential... 2019-12-24T22:06:38.461 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2019-12-24T22:06:38.462 INFO:tasks.radosbench:Beginning radosbench... 2019-12-24T22:06:38.462 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_0 2019-12-24T22:06:38.462 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool create unique_pool_0 16 2019-12-24T22:06:38.463 INFO:tasks.thrashosds.thrasher:starting do_thrash 2019-12-24T22:06:38.463 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] out_osds: [] dead_osds: [] live_osds: [11, 10, 1, 0, 3, 2, 5, 4, 7, 6, 9, 8] 2019-12-24T22:06:38.463 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2019-12-24T22:06:38.463 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2019-12-24T22:06:38.464 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:06:38.464 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2019-12-24T22:06:38.464 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-24T22:06:38.465 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2019-12-24T22:06:38.465 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-24T22:06:38.465 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2019-12-24T22:06:38.466 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd set noscrub 2019-12-24T22:06:38.631 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:38.727 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:06:38.834 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:06:38.954 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:39.076 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:06:39.184 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:06:39.313 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:39.402 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:06:39.511 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:06:39.644 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:39.769 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:06:39.876 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:06:40.024 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:40.177 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:06:40.282 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:06:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:40.778 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:06:40.883 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:06:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:41.483 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:06:41.681 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:06:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:41.924 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:06:42.033 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:06:42.199 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:42.319 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:06:42.424 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:06:42.548 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:42.666 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:06:42.695 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:06:42.716 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:06:42.738 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:06:42.761 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:06:42.775 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:06:42.786 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:06:42.813 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:06:42.837 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:06:42.862 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:06:42.885 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:06:42.887 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:42.908 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:06:42.908 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9: {} 2019-12-24T22:06:42.937 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:06:42.959 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:06:42.961 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-24T22:06:42.961 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-24T22:06:42.961 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-24T22:06:42.961 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-24T22:06:42.962 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-24T22:06:42.962 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-24T22:06:42.962 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-24T22:06:42.962 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-24T22:06:42.962 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-24T22:06:42.962 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-24T22:06:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-24T22:06:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-24T22:06:42.993 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:06:43.101 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:06:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is set 2019-12-24T22:06:43.176 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_0' created 2019-12-24T22:06:43.238 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:43.579 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:06:43.775 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:06:43.776 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-24T22:06:43.859 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:06:43.970 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:44.223 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:06:44.509 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:06:44.533 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2019-12-24T22:06:44.621 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:44.835 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:06:44.941 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:06:45.066 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:45.157 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:06:45.264 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:06:45.372 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:45.760 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:06:45.867 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:06:45.990 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:46.099 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-24T22:06:46.177 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:06:46.360 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.9 2019-12-24T22:06:46.471 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:46.537 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-24T22:06:46.551 INFO:teuthology.orchestra.run.smithi124.stdout:4f472c8d2b7010caabd0b9a6f808a25a831297e83221fb2edb973dfe179278ce 2019-12-24T22:06:46.658 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:06:46.774 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:46.873 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:06:46.876 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:06:46.984 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:06:47.105 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:47.215 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:06:47.323 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.9 2019-12-24T22:06:47.441 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:47.554 INFO:teuthology.orchestra.run.smithi124.stdout:4f472c8d2b7010caabd0b9a6f808a25a831297e83221fb2edb973dfe179278ce 2019-12-24T22:06:47.662 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:06:47.754 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:06:47.754 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-24T22:06:47.786 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:47.882 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:06:47.988 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:06:48.079 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:48.102 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rados' on pool 'unique_pool_0' 2019-12-24T22:06:48.520 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:06:48.635 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:06:48.765 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:49.050 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:06:49.183 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:06:49.303 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:49.391 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:06:49.496 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:06:49.613 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:49.913 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:06:49.933 INFO:teuthology.orchestra.run.smithi124:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.2 -b 65536 -O 65536 -p unique_pool_0 bench 90 write' 2019-12-24T22:06:49.934 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_0 2019-12-24T22:06:49.934 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph pg dump --format=json 2019-12-24T22:06:49.935 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:06:49.938 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2019-12-24T22:06:49.938 INFO:teuthology.orchestra.run:waiting for 3000 2019-12-24T22:06:49.957 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:06:49.979 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:06:50.003 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:06:50.023 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:06:50.027 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:06:50.056 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:06:50.081 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:06:50.107 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:06:50.151 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:06:50.161 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9: {} 2019-12-24T22:06:50.161 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:06:50.182 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:06:50.183 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-24T22:06:50.183 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-24T22:06:50.183 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-24T22:06:50.184 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-24T22:06:50.184 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-24T22:06:50.184 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-24T22:06:50.184 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-24T22:06:50.184 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-24T22:06:50.184 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-24T22:06:50.184 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-24T22:06:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-24T22:06:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-24T22:06:50.198 INFO:tasks.radosbench.radosbench.2.smithi124.stderr:unrecognized command -O; -h or --help for usage 2019-12-24T22:06:50.198 INFO:tasks.radosbench.radosbench.2.smithi124.stderr:error 22: (22) Invalid argument 2019-12-24T22:06:50.225 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:50.638 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:06:50.941 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:06:51.056 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:51.150 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:06:51.175 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is set 2019-12-24T22:06:51.257 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:06:51.376 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:51.465 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:06:51.572 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:06:51.692 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:51.781 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:06:51.885 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:06:51.888 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:06:52.053 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:52.423 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:06:52.548 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:06:52.549 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-24T22:06:52.625 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:06:52.731 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:52.876 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:06:52.981 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:06:53.089 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:53.175 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:06:53.179 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-24T22:06:53.281 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:06:53.313 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:06:53.329 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2019-12-24T22:06:53.394 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:53.475 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:06:53.582 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:06:53.699 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:53.800 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:06:53.907 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:06:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:54.042 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd unset noscrub 2019-12-24T22:06:54.123 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:06:54.230 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:06:54.312 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:54.384 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":336,"stamp":"2019-12-24T22:06:53.183985+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":12591000,"kb_used_data":7992,"kb_used_omap":0,"kb_used_meta":12582912,"kb_avail":1112350824,"statfs":{"total":1151940427776,"available":1139047243776,"internally_reserved":12884901888,"allocated":8183808,"data_stored":4145638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12884901888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.f","version":"0'0","reported_seq":"11","reported_epoch":"81","state":"active+clean","last_fresh":"2019-12-24T22:06:45.528167+0000","last_change":"2019-12-24T22:06:44.191275+0000","last_active":"2019-12-24T22:06:45.528167+0000","last_peered":"2019-12-24T22:06:45.528167+0000","last_clean":"2019-12-24T22:06:45.528167+0000","last_became_active":"2019-12-24T22:06:44.190407+0000","last_became_peered":"2019-12-24T22:06:44.190407+0000","last_unstale":"2019-12-24T22:06:45.528167+0000","last_undegraded":"2019-12-24T22:06:45.528167+0000","last_fullsized":"2019-12-24T22:06:45.528167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_clean_scrub_stamp":"2019-12-24T22:06:43.164849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.e","version":"0'0","reported_seq":"13","reported_epoch":"83","state":"active+clean","last_fresh":"2019-12-24T22:06:51.171085+0000","last_change":"2019-12-24T22:06:44.195129+0000","last_active":"2019-12-24T22:06:51.171085+0000","last_peered":"2019-12-24T22:06:51.171085+0000","last_clean":"2019-12-24T22:06:51.171085+0000","last_became_active":"2019-12-24T22:06:44.194175+0000","last_became_peered":"2019-12-24T22:06:44.194175+0000","last_unstale":"2019-12-24T22:06:51.171085+0000","last_undegraded":"2019-12-24T22:06:51.171085+0000","last_fullsized":"2019-12-24T22:06:51.171085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_clean_scrub_stamp":"2019-12-24T22:06:43.164849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,3],"acting":[4,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.d","version":"0'0","reported_seq":"11","reported_epoch":"81","state":"active+clean","last_fresh":"2019-12-24T22:06:45.958815+0000","last_change":"2019-12-24T22:06:44.192013+0000","last_active":"2019-12-24T22:06:45.958815+0000","last_peered":"2019-12-24T22:06:45.958815+0000","last_clean":"2019-12-24T22:06:45.958815+0000","last_became_active":"2019-12-24T22:06:44.190642+0000","last_became_peered":"2019-12-24T22:06:44.190642+0000","last_unstale":"2019-12-24T22:06:45.958815+0000","last_undegraded":"2019-12-24T22:06:45.958815+0000","last_fullsized":"2019-12-24T22:06:45.958815+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_clean_scrub_stamp":"2019-12-24T22:06:43.164849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.c","version":"0'0","reported_seq":"13","reported_epoch":"83","state":"active+clean","last_fresh":"2019-12-24T22:06:51.739555+0000","last_change":"2019-12-24T22:06:44.500592+0000","last_active":"2019-12-24T22:06:51.739555+0000","last_peered":"2019-12-24T22:06:51.739555+0000","last_clean":"2019-12-24T22:06:51.739555+0000","last_became_active":"2019-12-24T22:06:44.499224+0000","last_became_peered":"2019-12-24T22:06:44.499224+0000","last_unstale":"2019-12-24T22:06:51.739555+0000","last_undegraded":"2019-12-24T22:06:51.739555+0000","last_fullsized":"2019-12-24T22:06:51.739555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_clean_scrub_stamp":"2019-12-24T22:06:43.164849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.b","version":"0'0","reported_seq":"11","reported_epoch":"81","state":"active+clean","last_fresh":"2019-12-24T22:06:45.479463+0000","last_change":"2019-12-24T22:06:44.502668+0000","last_active":"2019-12-24T22:06:45.479463+0000","last_peered":"2019-12-24T22:06:45.479463+0000","last_clean":"2019-12-24T22:06:45.479463+0000","last_became_active":"2019-12-24T22:06:44.501706+0000","last_became_peered":"2019-12-24T22:06:44.501706+0000","last_unstale":"2019-12-24T22:06:45.479463+0000","last_undegraded":"2019-12-24T22:06:45.479463+0000","last_fullsized":"2019-12-24T22:06:45.479463+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_clean_scrub_stamp":"2019-12-24T22:06:43.164849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,5],"acting":[11,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.a","version":"0'0","reported_seq":"13","reported_epoch":"83","state":"active+clean","last_fresh":"2019-12-24T22:06:51.743288+0000","last_change":"2019-12-24T22:06:44.193667+0000","last_active":"2019-12-24T22:06:51.743288+0000","last_peered":"2019-12-24T22:06:51.743288+0000","last_clean":"2019-12-24T22:06:51.743288+0000","last_became_active":"2019-12-24T22:06:44.192744+0000","last_became_peered":"2019-12-24T22:06:44.192744+0000","last_unstale":"2019-12-24T22:06:51.743288+0000","last_undegraded":"2019-12-24T22:06:51.743288+0000","last_fullsized":"2019-12-24T22:06:51.743288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_clean_scrub_stamp":"2019-12-24T22:06:43.164849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,4],"acting":[9,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.9","version":"0'0","reported_seq":"11","reported_epoch":"81","state":"active+clean","last_fresh":"2019-12-24T22:06:45.958713+0000","last_change":"2019-12-24T22:06:44.498661+0000","last_active":"2019-12-24T22:06:45.958713+0000","last_peered":"2019-12-24T22:06:45.958713+0000","last_clean":"2019-12-24T22:06:45.958713+0000","last_became_active":"2019-12-24T22:06:44.496772+0000","last_became_peered":"2019-12-24T22:06:44.496772+0000","last_unstale":"2019-12-24T22:06:45.958713+0000","last_undegraded":"2019-12-24T22:06:45.958713+0000","last_fullsized":"2019-12-24T22:06:45.958713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_clean_scrub_stamp":"2019-12-24T22:06:43.164849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,2],"acting":[7,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.8","version":"0'0","reported_seq":"13","reported_epoch":"83","state":"active+clean","last_fresh":"2019-12-24T22:06:51.736905+0000","last_change":"2019-12-24T22:06:44.497218+0000","last_active":"2019-12-24T22:06:51.736905+0000","last_peered":"2019-12-24T22:06:51.736905+0000","last_clean":"2019-12-24T22:06:51.736905+0000","last_became_active":"2019-12-24T22:06:44.496075+0000","last_became_peered":"2019-12-24T22:06:44.496075+0000","last_unstale":"2019-12-24T22:06:51.736905+0000","last_undegraded":"2019-12-24T22:06:51.736905+0000","last_fullsized":"2019-12-24T22:06:51.736905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_clean_scrub_stamp":"2019-12-24T22:06:43.164849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"11","reported_epoch":"81","state":"active+clean","last_fresh":"2019-12-24T22:06:45.528355+0000","last_change":"2019-12-24T22:06:44.189818+0000","last_active":"2019-12-24T22:06:45.528355+0000","last_peered":"2019-12-24T22:06:45.528355+0000","last_clean":"2019-12-24T22:06:45.528355+0000","last_became_active":"2019-12-24T22:06:44.188375+0000","last_became_peered":"2019-12-24T22:06:44.188375+0000","last_unstale":"2019-12-24T22:06:45.528355+0000","last_undegraded":"2019-12-24T22:06:45.528355+0000","last_fullsized":"2019-12-24T22:06:45.528355+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_clean_scrub_stamp":"2019-12-24T22:06:43.164849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,3],"acting":[6,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"11","reported_epoch":"81","state":"active+clean","last_fresh":"2019-12-24T22:06:45.532260+0000","last_change":"2019-12-24T22:06:44.222785+0000","last_active":"2019-12-24T22:06:45.532260+0000","last_peered":"2019-12-24T22:06:45.532260+0000","last_clean":"2019-12-24T22:06:45.532260+0000","last_became_active":"2019-12-24T22:06:44.221701+0000","last_became_peered":"2019-12-24T22:06:44.221701+0000","last_unstale":"2019-12-24T22:06:45.532260+0000","last_undegraded":"2019-12-24T22:06:45.532260+0000","last_fullsized":"2019-12-24T22:06:45.532260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_clean_scrub_stamp":"2019-12-24T22:06:43.164849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"11","reported_epoch":"81","state":"active+clean","last_fresh":"2019-12-24T22:06:45.532112+0000","last_change":"2019-12-24T22:06:44.502061+0000","last_active":"2019-12-24T22:06:45.532112+0000","last_peered":"2019-12-24T22:06:45.532112+0000","last_clean":"2019-12-24T22:06:45.532112+0000","last_became_active":"2019-12-24T22:06:44.500992+0000","last_became_peered":"2019-12-24T22:06:44.500992+0000","last_unstale":"2019-12-24T22:06:45.532112+0000","last_undegraded":"2019-12-24T22:06:45.532112+0000","last_fullsized":"2019-12-24T22:06:45.532112+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_clean_scrub_stamp":"2019-12-24T22:06:43.164849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"11","reported_epoch":"81","state":"active+clean","last_fresh":"2019-12-24T22:06:45.958654+0000","last_change":"2019-12-24T22:06:44.192625+0000","last_active":"2019-12-24T22:06:45.958654+0000","last_peered":"2019-12-24T22:06:45.958654+0000","last_clean":"2019-12-24T22:06:45.958654+0000","last_became_active":"2019-12-24T22:06:44.190641+0000","last_became_peered":"2019-12-24T22:06:44.190641+0000","last_unstale":"2019-12-24T22:06:45.958654+0000","last_undegraded":"2019-12-24T22:06:45.958654+0000","last_fullsized":"2019-12-24T22:06:45.958654+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_clean_scrub_stamp":"2019-12-24T22:06:43.164849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,6],"acting":[7,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"11","reported_epoch":"81","state":"active+clean","last_fresh":"2019-12-24T22:06:45.958646+0000","last_change":"2019-12-24T22:06:44.496911+0000","last_active":"2019-12-24T22:06:45.958646+0000","last_peered":"2019-12-24T22:06:45.958646+0000","last_clean":"2019-12-24T22:06:45.958646+0000","last_became_active":"2019-12-24T22:06:44.495815+0000","last_became_peered":"2019-12-24T22:06:44.495815+0000","last_unstale":"2019-12-24T22:06:45.958646+0000","last_undegraded":"2019-12-24T22:06:45.958646+0000","last_fullsized":"2019-12-24T22:06:45.958646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_clean_scrub_stamp":"2019-12-24T22:06:43.164849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"12","reported_epoch":"82","state":"active+clean","last_fresh":"2019-12-24T22:06:48.104273+0000","last_change":"2019-12-24T22:06:44.190911+0000","last_active":"2019-12-24T22:06:48.104273+0000","last_peered":"2019-12-24T22:06:48.104273+0000","last_clean":"2019-12-24T22:06:48.104273+0000","last_became_active":"2019-12-24T22:06:44.190390+0000","last_became_peered":"2019-12-24T22:06:44.190390+0000","last_unstale":"2019-12-24T22:06:48.104273+0000","last_undegraded":"2019-12-24T22:06:48.104273+0000","last_fullsized":"2019-12-24T22:06:48.104273+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_clean_scrub_stamp":"2019-12-24T22:06:43.164849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"11","reported_epoch":"81","state":"active+clean","last_fresh":"2019-12-24T22:06:45.479454+0000","last_change":"2019-12-24T22:06:44.222718+0000","last_active":"2019-12-24T22:06:45.479454+0000","last_peered":"2019-12-24T22:06:45.479454+0000","last_clean":"2019-12-24T22:06:45.479454+0000","last_became_active":"2019-12-24T22:06:44.221704+0000","last_became_peered":"2019-12-24T22:06:44.221704+0000","last_unstale":"2019-12-24T22:06:45.479454+0000","last_undegraded":"2019-12-24T22:06:45.479454+0000","last_fullsized":"2019-12-24T22:06:45.479454+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_clean_scrub_stamp":"2019-12-24T22:06:43.164849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7],"acting":[11,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"11","reported_epoch":"81","state":"active+clean","last_fresh":"2019-12-24T22:06:45.532254+0000","last_change":"2019-12-24T22:06:44.501507+0000","last_active":"2019-12-24T22:06:45.532254+0000","last_peered":"2019-12-24T22:06:45.532254+0000","last_clean":"2019-12-24T22:06:45.532254+0000","last_became_active":"2019-12-24T22:06:44.500545+0000","last_became_peered":"2019-12-24T22:06:44.500545+0000","last_unstale":"2019-12-24T22:06:45.532254+0000","last_undegraded":"2019-12-24T22:06:45.532254+0000","last_fullsized":"2019-12-24T22:06:45.532254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-24T22:06:43.164849+0000","last_clean_scrub_stamp":"2019-12-24T22:06:43.164849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,6],"acting":[10,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":63,"seq":270582939675,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049232,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695920,"statfs":{"total":95995035648,"available":94920622080,"internally_reserved":1073741824,"allocated":663552,"data_stored":334667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.035,"5min":1.035,"15min":1.035},"min":{"1min":0.457,"5min":0.457,"15min":0.457},"max":{"1min":1.790,"5min":1.790,"15min":1.790},"last":0.563},{"interface":"front","average":{"1min":1.035,"5min":1.035,"15min":1.035},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.908,"5min":1.908,"15min":1.908},"last":1.021}]},{"osd":1,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.043,"5min":1.043,"15min":1.043},"min":{"1min":0.559,"5min":0.559,"15min":0.559},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":1.589},{"interface":"front","average":{"1min":0.920,"5min":0.920,"15min":0.920},"min":{"1min":0.591,"5min":0.591,"15min":0.591},"max":{"1min":1.539,"5min":1.539,"15min":1.539},"last":0.939}]},{"osd":2,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.946,"5min":0.946,"15min":0.946},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.059,"5min":2.059,"15min":2.059},"last":1.437},{"interface":"front","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.673,"5min":0.673,"15min":0.673},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.844}]},{"osd":3,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.140,"5min":1.140,"15min":1.140},"min":{"1min":0.518,"5min":0.518,"15min":0.518},"max":{"1min":2.138,"5min":2.138,"15min":2.138},"last":1.137},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.659,"5min":0.659,"15min":0.659},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.430}]},{"osd":4,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.965,"5min":0.965,"15min":0.965},"max":{"1min":2.013,"5min":2.013,"15min":2.013},"last":0.894},{"interface":"front","average":{"1min":1.260,"5min":1.260,"15min":1.260},"min":{"1min":0.786,"5min":0.786,"15min":0.786},"max":{"1min":2.197,"5min":2.197,"15min":2.197},"last":1.717}]},{"osd":5,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.533,"5min":1.533,"15min":1.533},"min":{"1min":1.098,"5min":1.098,"15min":1.098},"max":{"1min":2.455,"5min":2.455,"15min":2.455},"last":0.760},{"interface":"front","average":{"1min":1.350,"5min":1.350,"15min":1.350},"min":{"1min":0.674,"5min":0.674,"15min":0.674},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.244}]},{"osd":6,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.362,"5min":1.362,"15min":1.362},"min":{"1min":0.883,"5min":0.883,"15min":0.883},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.493},{"interface":"front","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":1.289,"5min":1.289,"15min":1.289},"max":{"1min":2.778,"5min":2.778,"15min":2.778},"last":1.830}]},{"osd":7,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":1.112,"5min":1.112,"15min":1.112},"max":{"1min":2.337,"5min":2.337,"15min":2.337},"last":1.915},{"interface":"front","average":{"1min":1.640,"5min":1.640,"15min":1.640},"min":{"1min":1.169,"5min":1.169,"15min":1.169},"max":{"1min":2.897,"5min":2.897,"15min":2.897},"last":1.366}]},{"osd":8,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.432,"5min":1.432,"15min":1.432},"min":{"1min":0.849,"5min":0.849,"15min":0.849},"max":{"1min":1.834,"5min":1.834,"15min":1.834},"last":1.085},{"interface":"front","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":1.076,"5min":1.076,"15min":1.076},"max":{"1min":3.173,"5min":3.173,"15min":3.173},"last":2.019}]},{"osd":10,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.461,"5min":1.461,"15min":1.461},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":1.808,"5min":1.808,"15min":1.808},"last":1.321},{"interface":"front","average":{"1min":1.701,"5min":1.701,"15min":1.701},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.985,"5min":2.985,"15min":2.985},"last":2.099}]}]},{"osd":10,"up_from":58,"seq":249108103199,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049244,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695908,"statfs":{"total":95995035648,"available":94920609792,"internally_reserved":1073741824,"allocated":675840,"data_stored":341990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.215}]},{"osd":1,"last update":"Tue Dec 24 22:06:38 2019","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.074,"15min":1.001},"min":{"1min":0.576,"5min":0.573,"15min":0.573},"max":{"1min":11.475,"5min":11.475,"15min":11.475},"last":1.137},{"interface":"front","average":{"1min":1.578,"5min":1.086,"15min":1.004},"min":{"1min":0.614,"5min":0.612,"15min":0.612},"max":{"1min":11.212,"5min":11.212,"15min":11.212},"last":0.692}]},{"osd":2,"last update":"Tue Dec 24 22:06:38 2019","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.088,"15min":1.019},"min":{"1min":0.602,"5min":0.575,"15min":0.575},"max":{"1min":11.548,"5min":11.548,"15min":11.548},"last":0.602},{"interface":"front","average":{"1min":1.516,"5min":1.122,"15min":1.056},"min":{"1min":0.589,"5min":0.589,"15min":0.589},"max":{"1min":11.336,"5min":11.336,"15min":11.336},"last":0.741}]},{"osd":3,"last update":"Tue Dec 24 22:06:38 2019","interfaces":[{"interface":"back","average":{"1min":1.654,"5min":1.417,"15min":1.377},"min":{"1min":0.665,"5min":0.579,"15min":0.579},"max":{"1min":11.396,"5min":11.396,"15min":11.396},"last":0.961},{"interface":"front","average":{"1min":1.608,"5min":1.532,"15min":1.520},"min":{"1min":0.548,"5min":0.548,"15min":0.548},"max":{"1min":11.285,"5min":11.285,"15min":11.285},"last":1.111}]},{"osd":4,"last update":"Tue Dec 24 22:06:38 2019","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.319,"15min":1.325},"min":{"1min":0.853,"5min":0.802,"15min":0.802},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.306},{"interface":"front","average":{"1min":1.364,"5min":1.352,"15min":1.350},"min":{"1min":0.951,"5min":0.882,"15min":0.882},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.671}]},{"osd":5,"last update":"Tue Dec 24 22:06:38 2019","interfaces":[{"interface":"back","average":{"1min":1.277,"5min":1.361,"15min":1.375},"min":{"1min":0.914,"5min":0.848,"15min":0.848},"max":{"1min":1.518,"5min":1.863,"15min":1.863},"last":0.872},{"interface":"front","average":{"1min":1.383,"5min":1.393,"15min":1.395},"min":{"1min":1.088,"5min":0.980,"15min":0.980},"max":{"1min":2.033,"5min":2.033,"15min":2.033},"last":1.366}]},{"osd":6,"last update":"Tue Dec 24 22:06:38 2019","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.306,"15min":1.324},"min":{"1min":0.861,"5min":0.750,"15min":0.750},"max":{"1min":1.636,"5min":2.063,"15min":2.063},"last":1.270},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.847,"5min":0.838,"15min":0.838},"max":{"1min":1.719,"5min":2.025,"15min":2.025},"last":1.798}]},{"osd":7,"last update":"Tue Dec 24 22:06:38 2019","interfaces":[{"interface":"back","average":{"1min":1.227,"5min":1.408,"15min":1.438},"min":{"1min":0.937,"5min":0.937,"15min":0.937},"max":{"1min":1.788,"5min":2.279,"15min":2.279},"last":1.468},{"interface":"front","average":{"1min":1.564,"5min":1.556,"15min":1.554},"min":{"1min":1.320,"5min":1.224,"15min":1.224},"max":{"1min":2.069,"5min":2.125,"15min":2.125},"last":1.578}]},{"osd":8,"last update":"Tue Dec 24 22:06:38 2019","interfaces":[{"interface":"back","average":{"1min":1.354,"5min":1.517,"15min":1.544},"min":{"1min":0.788,"5min":0.788,"15min":0.788},"max":{"1min":1.794,"5min":2.178,"15min":2.178},"last":1.526},{"interface":"front","average":{"1min":1.392,"5min":1.423,"15min":1.428},"min":{"1min":0.898,"5min":0.757,"15min":0.757},"max":{"1min":1.827,"5min":2.007,"15min":2.007},"last":1.029}]},{"osd":9,"last update":"Tue Dec 24 22:06:38 2019","interfaces":[{"interface":"back","average":{"1min":1.344,"5min":1.531,"15min":1.562},"min":{"1min":0.955,"5min":0.616,"15min":0.616},"max":{"1min":1.764,"5min":2.446,"15min":2.446},"last":1.337},{"interface":"front","average":{"1min":1.471,"5min":1.570,"15min":1.586},"min":{"1min":0.944,"5min":0.566,"15min":0.566},"max":{"1min":1.741,"5min":2.193,"15min":2.193},"last":1.181}]},{"osd":11,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.738,"5min":1.738,"15min":1.738},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.750},{"interface":"front","average":{"1min":1.588,"5min":1.588,"15min":1.588},"min":{"1min":1.143,"5min":1.143,"15min":1.143},"max":{"1min":2.123,"5min":2.123,"15min":2.123},"last":1.399}]}]},{"osd":9,"up_from":53,"seq":227633266723,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049256,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695896,"statfs":{"total":95995035648,"available":94920597504,"internally_reserved":1073741824,"allocated":688128,"data_stored":348973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":0.887,"5min":0.915,"15min":0.920},"min":{"1min":0.585,"5min":0.475,"15min":0.475},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":0.763},{"interface":"front","average":{"1min":0.965,"5min":0.901,"15min":0.890},"min":{"1min":0.574,"5min":0.484,"15min":0.484},"max":{"1min":2.330,"5min":2.330,"15min":2.330},"last":0.607}]},{"osd":1,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":0.856,"5min":0.841,"15min":0.839},"min":{"1min":0.562,"5min":0.562,"15min":0.562},"max":{"1min":1.482,"5min":1.660,"15min":1.660},"last":0.669},{"interface":"front","average":{"1min":1.124,"5min":1.098,"15min":1.094},"min":{"1min":0.785,"5min":0.674,"15min":0.674},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.557}]},{"osd":2,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.054,"15min":1.051},"min":{"1min":0.689,"5min":0.536,"15min":0.536},"max":{"1min":1.731,"5min":1.731,"15min":1.731},"last":1.049},{"interface":"front","average":{"1min":0.962,"5min":1.055,"15min":1.071},"min":{"1min":0.540,"5min":0.540,"15min":0.540},"max":{"1min":2.064,"5min":2.064,"15min":2.064},"last":0.837}]},{"osd":3,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.287,"5min":1.259,"15min":1.254},"min":{"1min":0.608,"5min":0.608,"15min":0.608},"max":{"1min":1.803,"5min":1.803,"15min":1.803},"last":1.208},{"interface":"front","average":{"1min":1.219,"5min":1.133,"15min":1.119},"min":{"1min":0.648,"5min":0.627,"15min":0.627},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":1.115}]},{"osd":4,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.142,"5min":0.965,"15min":0.935},"min":{"1min":0.742,"5min":0.484,"15min":0.484},"max":{"1min":1.842,"5min":1.842,"15min":1.842},"last":1.173},{"interface":"front","average":{"1min":1.480,"5min":1.348,"15min":1.326},"min":{"1min":0.872,"5min":0.803,"15min":0.803},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.574}]},{"osd":5,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.283,"5min":1.271,"15min":1.269},"min":{"1min":0.921,"5min":0.781,"15min":0.781},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.316},{"interface":"front","average":{"1min":1.228,"5min":1.127,"15min":1.110},"min":{"1min":1.003,"5min":0.843,"15min":0.843},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":1.258}]},{"osd":6,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.457,"5min":1.323,"15min":1.301},"min":{"1min":1.099,"5min":0.907,"15min":0.907},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.801},{"interface":"front","average":{"1min":1.376,"5min":1.238,"15min":1.215},"min":{"1min":1.041,"5min":0.751,"15min":0.751},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.007}]},{"osd":7,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.448,"15min":1.424},"min":{"1min":1.013,"5min":0.891,"15min":0.891},"max":{"1min":2.047,"5min":2.047,"15min":2.047},"last":1.398},{"interface":"front","average":{"1min":1.531,"5min":1.455,"15min":1.442},"min":{"1min":1.145,"5min":0.723,"15min":0.723},"max":{"1min":2.134,"5min":2.134,"15min":2.134},"last":1.517}]},{"osd":8,"last update":"Tue Dec 24 22:06:15 2019","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.392,"15min":1.368},"min":{"1min":1.038,"5min":0.555,"15min":0.555},"max":{"1min":2.212,"5min":2.212,"15min":2.212},"last":1.693},{"interface":"front","average":{"1min":1.616,"5min":1.417,"15min":1.384},"min":{"1min":1.192,"5min":0.605,"15min":0.605},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":1.621}]},{"osd":10,"last update":"Tue Dec 24 22:06:35 2019","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.312,"15min":1.314},"min":{"1min":0.736,"5min":0.736,"15min":0.736},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.449},{"interface":"front","average":{"1min":1.710,"5min":1.671,"15min":1.665},"min":{"1min":1.368,"5min":1.212,"15min":1.212},"max":{"1min":2.132,"5min":2.132,"15min":2.132},"last":1.756}]}]},{"osd":8,"up_from":48,"seq":206158430247,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049244,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695908,"statfs":{"total":95995035648,"available":94920609792,"internally_reserved":1073741824,"allocated":675840,"data_stored":341990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.887,"5min":0.873,"15min":0.871},"min":{"1min":0.512,"5min":0.512,"15min":0.512},"max":{"1min":1.441,"5min":2.639,"15min":2.639},"last":0.617},{"interface":"front","average":{"1min":0.795,"5min":0.792,"15min":0.792},"min":{"1min":0.480,"5min":0.480,"15min":0.480},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.692}]},{"osd":1,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.983,"5min":1.044,"15min":1.054},"min":{"1min":0.585,"5min":0.585,"15min":0.585},"max":{"1min":1.346,"5min":1.864,"15min":1.864},"last":1.015},{"interface":"front","average":{"1min":1.007,"5min":1.123,"15min":1.142},"min":{"1min":0.470,"5min":0.470,"15min":0.470},"max":{"1min":1.620,"5min":2.751,"15min":2.751},"last":0.880}]},{"osd":2,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.897,"5min":0.953,"15min":0.962},"min":{"1min":0.579,"5min":0.579,"15min":0.579},"max":{"1min":1.315,"5min":1.581,"15min":1.581},"last":0.793},{"interface":"front","average":{"1min":1.043,"5min":1.039,"15min":1.039},"min":{"1min":0.550,"5min":0.550,"15min":0.550},"max":{"1min":1.542,"5min":1.813,"15min":1.813},"last":1.274}]},{"osd":3,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":0.961,"5min":0.969,"15min":0.971},"min":{"1min":0.567,"5min":0.563,"15min":0.563},"max":{"1min":1.448,"5min":1.669,"15min":1.669},"last":1.197},{"interface":"front","average":{"1min":1.168,"5min":1.140,"15min":1.135},"min":{"1min":0.631,"5min":0.631,"15min":0.631},"max":{"1min":1.558,"5min":2.925,"15min":2.925},"last":0.748}]},{"osd":4,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.194,"15min":1.188},"min":{"1min":0.866,"5min":0.659,"15min":0.659},"max":{"1min":1.567,"5min":2.839,"15min":2.839},"last":1.081},{"interface":"front","average":{"1min":0.991,"5min":1.067,"15min":1.079},"min":{"1min":0.748,"5min":0.726,"15min":0.726},"max":{"1min":1.284,"5min":1.617,"15min":1.617},"last":0.935}]},{"osd":5,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.357,"15min":1.355},"min":{"1min":1.056,"5min":0.958,"15min":0.958},"max":{"1min":1.876,"5min":1.916,"15min":1.916},"last":1.366},{"interface":"front","average":{"1min":1.576,"5min":1.510,"15min":1.499},"min":{"1min":1.034,"5min":1.008,"15min":1.008},"max":{"1min":1.863,"5min":3.434,"15min":3.434},"last":1.410}]},{"osd":6,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.200,"15min":1.194},"min":{"1min":0.769,"5min":0.769,"15min":0.769},"max":{"1min":1.723,"5min":1.723,"15min":1.723},"last":1.335},{"interface":"front","average":{"1min":1.435,"5min":1.390,"15min":1.382},"min":{"1min":1.018,"5min":0.862,"15min":0.862},"max":{"1min":1.880,"5min":2.141,"15min":2.141},"last":1.447}]},{"osd":7,"last update":"Tue Dec 24 22:05:57 2019","interfaces":[{"interface":"back","average":{"1min":1.465,"5min":1.493,"15min":1.498},"min":{"1min":0.972,"5min":0.897,"15min":0.897},"max":{"1min":1.770,"5min":3.335,"15min":3.335},"last":1.529},{"interface":"front","average":{"1min":1.311,"5min":1.335,"15min":1.339},"min":{"1min":0.897,"5min":0.897,"15min":0.897},"max":{"1min":1.509,"5min":1.845,"15min":1.845},"last":1.152}]},{"osd":9,"last update":"Tue Dec 24 22:06:17 2019","interfaces":[{"interface":"back","average":{"1min":1.311,"5min":1.329,"15min":1.332},"min":{"1min":0.877,"5min":0.523,"15min":0.523},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.577},{"interface":"front","average":{"1min":1.332,"5min":1.289,"15min":1.282},"min":{"1min":0.797,"5min":0.693,"15min":0.693},"max":{"1min":1.729,"5min":1.747,"15min":1.747},"last":1.702}]},{"osd":10,"last update":"Tue Dec 24 22:06:36 2019","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.411,"15min":1.397},"min":{"1min":1.057,"5min":0.854,"15min":0.854},"max":{"1min":1.980,"5min":1.980,"15min":1.980},"last":1.644},{"interface":"front","average":{"1min":1.519,"5min":1.531,"15min":1.533},"min":{"1min":1.139,"5min":0.705,"15min":0.705},"max":{"1min":2.059,"5min":2.257,"15min":2.257},"last":1.490}]}]},{"osd":7,"up_from":43,"seq":184683593771,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049244,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695908,"statfs":{"total":95995035648,"available":94920609792,"internally_reserved":1073741824,"allocated":675840,"data_stored":341990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:06:41 2019","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.185,"15min":1.167},"min":{"1min":0.612,"5min":0.612,"15min":0.612},"max":{"1min":5.635,"5min":5.635,"15min":5.635},"last":0.721},{"interface":"front","average":{"1min":1.333,"5min":1.167,"15min":1.149},"min":{"1min":0.584,"5min":0.584,"15min":0.584},"max":{"1min":5.587,"5min":5.587,"15min":5.587},"last":1.045}]},{"osd":1,"last update":"Tue Dec 24 22:06:41 2019","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.090,"15min":1.012},"min":{"1min":0.562,"5min":0.562,"15min":0.562},"max":{"1min":5.232,"5min":5.232,"15min":5.232},"last":0.898},{"interface":"front","average":{"1min":1.252,"5min":1.117,"15min":1.071},"min":{"1min":0.727,"5min":0.612,"15min":0.612},"max":{"1min":5.108,"5min":5.108,"15min":5.108},"last":0.776}]},{"osd":2,"last update":"Tue Dec 24 22:06:41 2019","interfaces":[{"interface":"back","average":{"1min":1.402,"5min":1.171,"15min":1.101},"min":{"1min":0.696,"5min":0.646,"15min":0.646},"max":{"1min":5.342,"5min":5.342,"15min":5.342},"last":0.996},{"interface":"front","average":{"1min":1.368,"5min":1.180,"15min":1.148},"min":{"1min":0.745,"5min":0.592,"15min":0.592},"max":{"1min":5.417,"5min":5.417,"15min":5.417},"last":1.133}]},{"osd":3,"last update":"Tue Dec 24 22:06:41 2019","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.203,"15min":1.149},"min":{"1min":0.662,"5min":0.636,"15min":0.636},"max":{"1min":5.468,"5min":5.468,"15min":5.468},"last":1.380},{"interface":"front","average":{"1min":1.428,"5min":1.175,"15min":1.135},"min":{"1min":0.769,"5min":0.769,"15min":0.769},"max":{"1min":5.677,"5min":5.677,"15min":5.677},"last":1.195}]},{"osd":4,"last update":"Tue Dec 24 22:06:41 2019","interfaces":[{"interface":"back","average":{"1min":0.982,"5min":1.035,"15min":1.073},"min":{"1min":0.583,"5min":0.494,"15min":0.494},"max":{"1min":1.509,"5min":2.270,"15min":2.270},"last":1.241},{"interface":"front","average":{"1min":1.200,"5min":1.129,"15min":1.141},"min":{"1min":0.732,"5min":0.703,"15min":0.703},"max":{"1min":1.772,"5min":1.815,"15min":1.815},"last":1.280}]},{"osd":5,"last update":"Tue Dec 24 22:06:41 2019","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.317,"15min":1.350},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.898,"5min":2.144,"15min":2.144},"last":1.015},{"interface":"front","average":{"1min":1.334,"5min":1.369,"15min":1.357},"min":{"1min":0.833,"5min":0.638,"15min":0.638},"max":{"1min":1.723,"5min":2.412,"15min":2.412},"last":1.294}]},{"osd":6,"last update":"Tue Dec 24 22:06:41 2019","interfaces":[{"interface":"back","average":{"1min":1.283,"5min":1.448,"15min":1.499},"min":{"1min":0.675,"5min":0.675,"15min":0.675},"max":{"1min":2.136,"5min":2.668,"15min":2.668},"last":1.440},{"interface":"front","average":{"1min":1.362,"5min":1.424,"15min":1.426},"min":{"1min":0.780,"5min":0.780,"15min":0.780},"max":{"1min":1.813,"5min":2.039,"15min":2.039},"last":1.308}]},{"osd":8,"last update":"Tue Dec 24 22:06:03 2019","interfaces":[{"interface":"back","average":{"1min":1.563,"5min":1.631,"15min":1.643},"min":{"1min":0.825,"5min":0.825,"15min":0.825},"max":{"1min":2.549,"5min":2.549,"15min":2.549},"last":1.824},{"interface":"front","average":{"1min":1.528,"5min":1.608,"15min":1.621},"min":{"1min":0.965,"5min":0.965,"15min":0.965},"max":{"1min":2.215,"5min":2.442,"15min":2.442},"last":1.581}]},{"osd":9,"last update":"Tue Dec 24 22:06:16 2019","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.678,"15min":1.693},"min":{"1min":1.158,"5min":1.136,"15min":1.136},"max":{"1min":2.033,"5min":2.558,"15min":2.558},"last":1.511},{"interface":"front","average":{"1min":1.628,"5min":1.756,"15min":1.777},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":2.183,"5min":2.398,"15min":2.398},"last":1.481}]},{"osd":10,"last update":"Tue Dec 24 22:06:35 2019","interfaces":[{"interface":"back","average":{"1min":1.744,"5min":1.730,"15min":1.728},"min":{"1min":1.339,"5min":1.339,"15min":1.339},"max":{"1min":2.388,"5min":2.388,"15min":2.388},"last":1.967},{"interface":"front","average":{"1min":1.690,"5min":1.729,"15min":1.735},"min":{"1min":0.971,"5min":0.971,"15min":0.971},"max":{"1min":2.241,"5min":2.289,"15min":2.289},"last":1.633}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.922}]}]},{"osd":6,"up_from":38,"seq":163208757295,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049244,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695908,"statfs":{"total":95995035648,"available":94920609792,"internally_reserved":1073741824,"allocated":675840,"data_stored":341990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:06:23 2019","interfaces":[{"interface":"back","average":{"1min":0.967,"5min":0.986,"15min":0.997},"min":{"1min":0.591,"5min":0.462,"15min":0.462},"max":{"1min":1.534,"5min":1.548,"15min":1.548},"last":1.193},{"interface":"front","average":{"1min":1.080,"5min":0.997,"15min":0.992},"min":{"1min":0.574,"5min":0.548,"15min":0.548},"max":{"1min":1.765,"5min":1.765,"15min":1.765},"last":0.849}]},{"osd":1,"last update":"Tue Dec 24 22:06:23 2019","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.029,"15min":0.959},"min":{"1min":0.621,"5min":0.574,"15min":0.574},"max":{"1min":1.809,"5min":7.126,"15min":7.126},"last":0.961},{"interface":"front","average":{"1min":1.107,"5min":1.092,"15min":1.016},"min":{"1min":0.851,"5min":0.677,"15min":0.677},"max":{"1min":1.488,"5min":7.085,"15min":7.085},"last":1.460}]},{"osd":2,"last update":"Tue Dec 24 22:06:23 2019","interfaces":[{"interface":"back","average":{"1min":1.203,"5min":1.133,"15min":1.117},"min":{"1min":0.836,"5min":0.688,"15min":0.688},"max":{"1min":2.060,"5min":2.060,"15min":2.060},"last":0.908},{"interface":"front","average":{"1min":1.225,"5min":1.179,"15min":1.182},"min":{"1min":0.568,"5min":0.568,"15min":0.568},"max":{"1min":1.850,"5min":2.626,"15min":2.626},"last":1.597}]},{"osd":3,"last update":"Tue Dec 24 22:06:23 2019","interfaces":[{"interface":"back","average":{"1min":1.128,"5min":1.073,"15min":1.055},"min":{"1min":0.591,"5min":0.591,"15min":0.591},"max":{"1min":2.633,"5min":2.633,"15min":2.633},"last":1.328},{"interface":"front","average":{"1min":0.999,"5min":1.100,"15min":1.153},"min":{"1min":0.653,"5min":0.591,"15min":0.591},"max":{"1min":1.692,"5min":1.692,"15min":1.692},"last":1.694}]},{"osd":4,"last update":"Tue Dec 24 22:06:23 2019","interfaces":[{"interface":"back","average":{"1min":1.126,"5min":1.124,"15min":1.123},"min":{"1min":0.641,"5min":0.485,"15min":0.485},"max":{"1min":1.731,"5min":1.731,"15min":1.731},"last":1.385},{"interface":"front","average":{"1min":1.266,"5min":1.218,"15min":1.209},"min":{"1min":0.771,"5min":0.700,"15min":0.700},"max":{"1min":1.578,"5min":2.005,"15min":2.005},"last":1.040}]},{"osd":5,"last update":"Tue Dec 24 22:06:23 2019","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.278,"15min":1.306},"min":{"1min":0.633,"5min":0.620,"15min":0.620},"max":{"1min":1.743,"5min":2.033,"15min":2.033},"last":1.750},{"interface":"front","average":{"1min":1.348,"5min":1.348,"15min":1.354},"min":{"1min":0.945,"5min":0.614,"15min":0.614},"max":{"1min":1.664,"5min":1.861,"15min":1.861},"last":1.826}]},{"osd":7,"last update":"Tue Dec 24 22:06:39 2019","interfaces":[{"interface":"back","average":{"1min":1.128,"5min":1.274,"15min":1.326},"min":{"1min":0.744,"5min":0.681,"15min":0.681},"max":{"1min":1.420,"5min":1.948,"15min":1.948},"last":1.155},{"interface":"front","average":{"1min":1.213,"5min":1.363,"15min":1.387},"min":{"1min":0.747,"5min":0.708,"15min":0.708},"max":{"1min":1.814,"5min":2.464,"15min":2.464},"last":1.793}]},{"osd":8,"last update":"Tue Dec 24 22:05:58 2019","interfaces":[{"interface":"back","average":{"1min":1.615,"5min":1.699,"15min":1.713},"min":{"1min":1.200,"5min":1.200,"15min":1.200},"max":{"1min":2.000,"5min":2.450,"15min":2.450},"last":2.222},{"interface":"front","average":{"1min":1.517,"5min":1.655,"15min":1.678},"min":{"1min":1.236,"5min":1.236,"15min":1.236},"max":{"1min":1.937,"5min":2.224,"15min":2.224},"last":1.039}]},{"osd":9,"last update":"Tue Dec 24 22:06:18 2019","interfaces":[{"interface":"back","average":{"1min":1.757,"5min":1.795,"15min":1.801},"min":{"1min":1.480,"5min":1.426,"15min":1.426},"max":{"1min":2.197,"5min":2.282,"15min":2.282},"last":1.973},{"interface":"front","average":{"1min":1.654,"5min":1.683,"15min":1.688},"min":{"1min":1.339,"5min":1.115,"15min":1.115},"max":{"1min":2.808,"5min":2.808,"15min":2.808},"last":1.867}]},{"osd":10,"last update":"Tue Dec 24 22:06:39 2019","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.775,"15min":1.801},"min":{"1min":1.106,"5min":1.106,"15min":1.106},"max":{"1min":1.961,"5min":2.603,"15min":2.603},"last":1.923},{"interface":"front","average":{"1min":1.826,"5min":1.724,"15min":1.707},"min":{"1min":1.459,"5min":1.314,"15min":1.314},"max":{"1min":2.150,"5min":2.150,"15min":2.150},"last":2.154}]}]},{"osd":1,"up_from":12,"seq":51539607620,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049244,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695908,"statfs":{"total":95995035648,"available":94920609792,"internally_reserved":1073741824,"allocated":675840,"data_stored":341990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:06:44 2019","interfaces":[{"interface":"back","average":{"1min":0.955,"5min":0.813,"15min":0.692},"min":{"1min":0.328,"5min":0.328,"15min":0.328},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":0.612},{"interface":"front","average":{"1min":0.851,"5min":0.801,"15min":0.753},"min":{"1min":0.449,"5min":0.285,"15min":0.285},"max":{"1min":1.335,"5min":1.701,"15min":1.701},"last":0.367}]},{"osd":2,"last update":"Tue Dec 24 22:06:00 2019","interfaces":[{"interface":"back","average":{"1min":0.812,"5min":0.830,"15min":0.787},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.626,"5min":1.626,"15min":1.626},"last":1.261},{"interface":"front","average":{"1min":0.926,"5min":0.789,"15min":0.772},"min":{"1min":0.538,"5min":0.538,"15min":0.538},"max":{"1min":2.075,"5min":2.075,"15min":2.075},"last":1.241}]},{"osd":3,"last update":"Tue Dec 24 22:06:14 2019","interfaces":[{"interface":"back","average":{"1min":0.919,"5min":0.902,"15min":0.819},"min":{"1min":0.521,"5min":0.515,"15min":0.515},"max":{"1min":1.728,"5min":1.866,"15min":1.866},"last":0.788},{"interface":"front","average":{"1min":1.112,"5min":1.042,"15min":0.983},"min":{"1min":0.508,"5min":0.508,"15min":0.508},"max":{"1min":2.152,"5min":2.152,"15min":2.152},"last":0.746}]},{"osd":4,"last update":"Tue Dec 24 22:06:40 2019","interfaces":[{"interface":"back","average":{"1min":1.110,"5min":1.015,"15min":0.962},"min":{"1min":0.549,"5min":0.549,"15min":0.549},"max":{"1min":1.781,"5min":1.781,"15min":1.781},"last":1.331},{"interface":"front","average":{"1min":1.200,"5min":1.132,"15min":1.062},"min":{"1min":0.773,"5min":0.701,"15min":0.701},"max":{"1min":1.971,"5min":1.971,"15min":1.971},"last":0.973}]},{"osd":5,"last update":"Tue Dec 24 22:06:00 2019","interfaces":[{"interface":"back","average":{"1min":1.289,"5min":1.283,"15min":1.309},"min":{"1min":0.829,"5min":0.733,"15min":0.733},"max":{"1min":2.551,"5min":2.551,"15min":2.551},"last":0.933},{"interface":"front","average":{"1min":1.471,"5min":1.153,"15min":1.005},"min":{"1min":0.921,"5min":0.619,"15min":0.619},"max":{"1min":2.243,"5min":2.243,"15min":2.243},"last":1.185}]},{"osd":6,"last update":"Tue Dec 24 22:06:18 2019","interfaces":[{"interface":"back","average":{"1min":1.313,"5min":1.252,"15min":1.202},"min":{"1min":0.730,"5min":0.618,"15min":0.618},"max":{"1min":2.094,"5min":2.094,"15min":2.094},"last":1.382},{"interface":"front","average":{"1min":1.445,"5min":1.488,"15min":1.482},"min":{"1min":0.907,"5min":0.802,"15min":0.802},"max":{"1min":2.075,"5min":2.358,"15min":2.358},"last":0.875}]},{"osd":7,"last update":"Tue Dec 24 22:06:40 2019","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.364,"15min":1.340},"min":{"1min":0.661,"5min":0.661,"15min":0.661},"max":{"1min":2.011,"5min":2.212,"15min":2.212},"last":1.209},{"interface":"front","average":{"1min":1.413,"5min":1.541,"15min":1.547},"min":{"1min":0.699,"5min":0.699,"15min":0.699},"max":{"1min":2.195,"5min":2.475,"15min":2.475},"last":1.096}]},{"osd":8,"last update":"Tue Dec 24 22:06:00 2019","interfaces":[{"interface":"back","average":{"1min":1.582,"5min":1.633,"15min":1.641},"min":{"1min":1.093,"5min":1.093,"15min":1.093},"max":{"1min":2.716,"5min":2.716,"15min":2.716},"last":1.033},{"interface":"front","average":{"1min":1.528,"5min":1.660,"15min":1.682},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":2.032,"5min":2.556,"15min":2.556},"last":1.279}]},{"osd":9,"last update":"Tue Dec 24 22:06:14 2019","interfaces":[{"interface":"back","average":{"1min":1.683,"5min":1.508,"15min":1.479},"min":{"1min":0.985,"5min":0.985,"15min":0.985},"max":{"1min":2.631,"5min":2.631,"15min":2.631},"last":1.143},{"interface":"front","average":{"1min":1.650,"5min":1.704,"15min":1.713},"min":{"1min":1.083,"5min":1.083,"15min":1.083},"max":{"1min":2.319,"5min":2.621,"15min":2.621},"last":1.120}]},{"osd":10,"last update":"Tue Dec 24 22:06:40 2019","interfaces":[{"interface":"back","average":{"1min":1.652,"5min":1.530,"15min":1.510},"min":{"1min":0.933,"5min":0.933,"15min":0.933},"max":{"1min":2.786,"5min":2.786,"15min":2.786},"last":0.815},{"interface":"front","average":{"1min":1.640,"5min":1.692,"15min":1.700},"min":{"1min":1.037,"5min":1.037,"15min":1.037},"max":{"1min":2.168,"5min":2.759,"15min":2.759},"last":1.060}]}]},{"osd":0,"up_from":7,"seq":30064771144,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049256,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695896,"statfs":{"total":95995035648,"available":94920597504,"internally_reserved":1073741824,"allocated":688128,"data_stored":348973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 24 22:06:44 2019","interfaces":[{"interface":"back","average":{"1min":0.756,"5min":0.694,"15min":0.592},"min":{"1min":0.429,"5min":0.355,"15min":0.355},"max":{"1min":1.354,"5min":1.568,"15min":1.568},"last":0.828},{"interface":"front","average":{"1min":0.702,"5min":0.798,"15min":0.678},"min":{"1min":0.363,"5min":0.363,"15min":0.363},"max":{"1min":1.111,"5min":1.505,"15min":1.505},"last":0.712}]},{"osd":2,"last update":"Tue Dec 24 22:03:53 2019","interfaces":[{"interface":"back","average":{"1min":0.700,"5min":0.667,"15min":0.661},"min":{"1min":0.512,"5min":0.371,"15min":0.371},"max":{"1min":0.944,"5min":0.944,"15min":0.944},"last":0.545},{"interface":"front","average":{"1min":0.927,"5min":0.779,"15min":0.755},"min":{"1min":0.614,"5min":0.452,"15min":0.452},"max":{"1min":1.197,"5min":1.197,"15min":1.197},"last":0.705}]},{"osd":3,"last update":"Tue Dec 24 22:06:18 2019","interfaces":[{"interface":"back","average":{"1min":0.930,"5min":0.906,"15min":0.814},"min":{"1min":0.462,"5min":0.462,"15min":0.462},"max":{"1min":1.520,"5min":2.013,"15min":2.013},"last":0.897},{"interface":"front","average":{"1min":0.772,"5min":0.847,"15min":0.843},"min":{"1min":0.452,"5min":0.452,"15min":0.452},"max":{"1min":1.420,"5min":1.580,"15min":1.580},"last":1.118}]},{"osd":4,"last update":"Tue Dec 24 22:06:44 2019","interfaces":[{"interface":"back","average":{"1min":1.037,"5min":1.043,"15min":1.045},"min":{"1min":0.749,"5min":0.571,"15min":0.571},"max":{"1min":1.961,"5min":1.961,"15min":1.961},"last":0.977},{"interface":"front","average":{"1min":1.202,"5min":1.214,"15min":1.130},"min":{"1min":0.688,"5min":0.688,"15min":0.688},"max":{"1min":1.930,"5min":1.930,"15min":1.930},"last":2.229}]},{"osd":5,"last update":"Tue Dec 24 22:05:58 2019","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.121,"15min":1.128},"min":{"1min":0.549,"5min":0.549,"15min":0.549},"max":{"1min":1.702,"5min":2.085,"15min":2.085},"last":1.215},{"interface":"front","average":{"1min":1.378,"5min":1.264,"15min":1.192},"min":{"1min":0.910,"5min":0.887,"15min":0.887},"max":{"1min":2.325,"5min":2.325,"15min":2.325},"last":1.826}]},{"osd":6,"last update":"Tue Dec 24 22:06:18 2019","interfaces":[{"interface":"back","average":{"1min":1.051,"5min":1.191,"15min":1.199},"min":{"1min":0.817,"5min":0.709,"15min":0.709},"max":{"1min":1.371,"5min":2.019,"15min":2.019},"last":1.519},{"interface":"front","average":{"1min":1.253,"5min":1.319,"15min":1.329},"min":{"1min":0.828,"5min":0.828,"15min":0.828},"max":{"1min":1.796,"5min":1.970,"15min":1.970},"last":1.869}]},{"osd":7,"last update":"Tue Dec 24 22:06:44 2019","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.255,"15min":1.303},"min":{"1min":0.671,"5min":0.671,"15min":0.671},"max":{"1min":1.648,"5min":2.114,"15min":2.114},"last":1.413},{"interface":"front","average":{"1min":1.246,"5min":1.394,"15min":1.423},"min":{"1min":0.782,"5min":0.774,"15min":0.774},"max":{"1min":1.977,"5min":2.231,"15min":2.231},"last":1.032}]},{"osd":8,"last update":"Tue Dec 24 22:05:58 2019","interfaces":[{"interface":"back","average":{"1min":1.567,"5min":1.656,"15min":1.671},"min":{"1min":1.030,"5min":1.030,"15min":1.030},"max":{"1min":3.015,"5min":3.015,"15min":3.015},"last":1.601},{"interface":"front","average":{"1min":1.444,"5min":1.484,"15min":1.490},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.771,"5min":2.771,"15min":2.771},"last":2.165}]},{"osd":9,"last update":"Tue Dec 24 22:06:18 2019","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.605,"15min":1.610},"min":{"1min":0.983,"5min":0.712,"15min":0.712},"max":{"1min":2.274,"5min":2.652,"15min":2.652},"last":2.065},{"interface":"front","average":{"1min":1.379,"5min":1.449,"15min":1.461},"min":{"1min":1.079,"5min":0.792,"15min":0.792},"max":{"1min":2.022,"5min":2.175,"15min":2.175},"last":1.659}]},{"osd":10,"last update":"Tue Dec 24 22:06:38 2019","interfaces":[{"interface":"back","average":{"1min":1.502,"5min":1.492,"15min":1.490},"min":{"1min":1.042,"5min":0.835,"15min":0.835},"max":{"1min":2.050,"5min":2.424,"15min":2.424},"last":1.972},{"interface":"front","average":{"1min":1.634,"5min":1.718,"15min":1.732},"min":{"1min":1.224,"5min":1.192,"15min":1.192},"max":{"1min":2.200,"5min":2.903,"15min":2.903},"last":2.342}]},{"osd":11,"last update":"Tue Dec 24 22:05:53 2019","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.986,"5min":0.986,"15min":0.986},"max":{"1min":2.571,"5min":2.571,"15min":2.571},"last":1.927},{"interface":"front","average":{"1min":1.864,"5min":1.864,"15min":1.864},"min":{"1min":1.023,"5min":1.023,"15min":1.023},"max":{"1min":9.942,"5min":9.942,"15min":9.942},"last":1.719}]}]},{"osd":2,"up_from":17,"seq":73014444095,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049244,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695908,"statfs":{"total":95995035648,"available":94920609792,"internally_reserved":1073741824,"allocated":675840,"data_stored":341990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:06:02 2019","interfaces":[{"interface":"back","average":{"1min":0.851,"5min":0.717,"15min":0.651},"min":{"1min":0.440,"5min":0.409,"15min":0.409},"max":{"1min":1.481,"5min":1.481,"15min":1.481},"last":0.403},{"interface":"front","average":{"1min":0.813,"5min":0.771,"15min":0.735},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.441}]},{"osd":1,"last update":"Tue Dec 24 22:06:02 2019","interfaces":[{"interface":"back","average":{"1min":0.840,"5min":0.741,"15min":0.685},"min":{"1min":0.510,"5min":0.448,"15min":0.448},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.567},{"interface":"front","average":{"1min":1.022,"5min":0.923,"15min":0.836},"min":{"1min":0.431,"5min":0.431,"15min":0.431},"max":{"1min":1.705,"5min":1.705,"15min":1.705},"last":0.603}]},{"osd":3,"last update":"Tue Dec 24 22:06:19 2019","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.873,"15min":0.785},"min":{"1min":0.513,"5min":0.513,"15min":0.513},"max":{"1min":1.687,"5min":1.687,"15min":1.687},"last":0.509},{"interface":"front","average":{"1min":1.163,"5min":0.966,"15min":0.864},"min":{"1min":0.577,"5min":0.513,"15min":0.513},"max":{"1min":1.584,"5min":1.584,"15min":1.584},"last":0.689}]},{"osd":4,"last update":"Tue Dec 24 22:06:40 2019","interfaces":[{"interface":"back","average":{"1min":1.150,"5min":1.012,"15min":0.955},"min":{"1min":0.727,"5min":0.494,"15min":0.494},"max":{"1min":1.740,"5min":1.973,"15min":1.973},"last":0.714},{"interface":"front","average":{"1min":1.106,"5min":1.083,"15min":1.050},"min":{"1min":0.585,"5min":0.551,"15min":0.551},"max":{"1min":1.929,"5min":2.039,"15min":2.039},"last":0.967}]},{"osd":5,"last update":"Tue Dec 24 22:06:02 2019","interfaces":[{"interface":"back","average":{"1min":1.539,"5min":1.253,"15min":1.161},"min":{"1min":0.912,"5min":0.788,"15min":0.788},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":0.738},{"interface":"front","average":{"1min":1.372,"5min":1.122,"15min":1.063},"min":{"1min":0.665,"5min":0.548,"15min":0.548},"max":{"1min":2.299,"5min":2.299,"15min":2.299},"last":0.900}]},{"osd":6,"last update":"Tue Dec 24 22:06:19 2019","interfaces":[{"interface":"back","average":{"1min":1.483,"5min":1.284,"15min":1.186},"min":{"1min":0.608,"5min":0.608,"15min":0.608},"max":{"1min":2.691,"5min":2.691,"15min":2.691},"last":0.858},{"interface":"front","average":{"1min":1.214,"5min":1.349,"15min":1.394},"min":{"1min":0.705,"5min":0.680,"15min":0.680},"max":{"1min":1.775,"5min":2.777,"15min":2.777},"last":0.646}]},{"osd":7,"last update":"Tue Dec 24 22:06:40 2019","interfaces":[{"interface":"back","average":{"1min":1.600,"5min":1.574,"15min":1.566},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":2.824,"5min":2.824,"15min":2.824},"last":0.797},{"interface":"front","average":{"1min":1.220,"5min":1.288,"15min":1.304},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.839,"5min":1.962,"15min":1.962},"last":0.826}]},{"osd":8,"last update":"Tue Dec 24 22:06:02 2019","interfaces":[{"interface":"back","average":{"1min":1.259,"5min":1.385,"15min":1.406},"min":{"1min":0.836,"5min":0.836,"15min":0.836},"max":{"1min":2.106,"5min":2.885,"15min":2.885},"last":0.755},{"interface":"front","average":{"1min":1.654,"5min":1.724,"15min":1.736},"min":{"1min":0.981,"5min":0.981,"15min":0.981},"max":{"1min":2.614,"5min":2.614,"15min":2.614},"last":0.945}]},{"osd":9,"last update":"Tue Dec 24 22:06:14 2019","interfaces":[{"interface":"back","average":{"1min":1.745,"5min":1.796,"15min":1.804},"min":{"1min":0.909,"5min":0.909,"15min":0.909},"max":{"1min":3.137,"5min":3.137,"15min":3.137},"last":0.990},{"interface":"front","average":{"1min":1.378,"5min":1.459,"15min":1.473},"min":{"1min":0.786,"5min":0.786,"15min":0.786},"max":{"1min":2.132,"5min":2.132,"15min":2.132},"last":0.924}]},{"osd":10,"last update":"Tue Dec 24 22:06:40 2019","interfaces":[{"interface":"back","average":{"1min":1.842,"5min":1.818,"15min":1.814},"min":{"1min":1.080,"5min":1.080,"15min":1.080},"max":{"1min":3.472,"5min":3.472,"15min":3.472},"last":1.025},{"interface":"front","average":{"1min":1.368,"5min":1.487,"15min":1.507},"min":{"1min":0.863,"5min":0.863,"15min":0.863},"max":{"1min":1.678,"5min":2.056,"15min":2.056},"last":0.882}]}]},{"osd":3,"up_from":22,"seq":94489280571,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049268,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695884,"statfs":{"total":95995035648,"available":94920585216,"internally_reserved":1073741824,"allocated":700416,"data_stored":356056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:04:18 2019","interfaces":[{"interface":"back","average":{"1min":0.605,"5min":0.621,"15min":0.623},"min":{"1min":0.400,"5min":0.400,"15min":0.400},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":1.298},{"interface":"front","average":{"1min":0.747,"5min":0.759,"15min":0.761},"min":{"1min":0.459,"5min":0.449,"15min":0.449},"max":{"1min":1.095,"5min":1.130,"15min":1.130},"last":1.349}]},{"osd":1,"last update":"Tue Dec 24 22:06:24 2019","interfaces":[{"interface":"back","average":{"1min":0.787,"5min":0.756,"15min":0.712},"min":{"1min":0.536,"5min":0.465,"15min":0.465},"max":{"1min":1.288,"5min":3.316,"15min":3.316},"last":0.683},{"interface":"front","average":{"1min":0.896,"5min":0.927,"15min":0.891},"min":{"1min":0.466,"5min":0.466,"15min":0.466},"max":{"1min":1.711,"5min":3.686,"15min":3.686},"last":1.049}]},{"osd":2,"last update":"Tue Dec 24 22:06:24 2019","interfaces":[{"interface":"back","average":{"1min":0.692,"5min":0.829,"15min":0.841},"min":{"1min":0.358,"5min":0.358,"15min":0.358},"max":{"1min":1.178,"5min":2.696,"15min":2.696},"last":1.250},{"interface":"front","average":{"1min":0.759,"5min":0.834,"15min":0.840},"min":{"1min":0.397,"5min":0.393,"15min":0.393},"max":{"1min":1.244,"5min":1.525,"15min":1.525},"last":1.318}]},{"osd":4,"last update":"Tue Dec 24 22:06:43 2019","interfaces":[{"interface":"back","average":{"1min":1.063,"5min":1.127,"15min":1.135},"min":{"1min":0.532,"5min":0.532,"15min":0.532},"max":{"1min":2.040,"5min":2.040,"15min":2.040},"last":1.797},{"interface":"front","average":{"1min":1.095,"5min":1.074,"15min":1.054},"min":{"1min":0.464,"5min":0.464,"15min":0.464},"max":{"1min":2.005,"5min":2.005,"15min":2.005},"last":1.874}]},{"osd":5,"last update":"Tue Dec 24 22:05:54 2019","interfaces":[{"interface":"back","average":{"1min":1.428,"5min":1.294,"15min":1.237},"min":{"1min":0.806,"5min":0.806,"15min":0.806},"max":{"1min":2.799,"5min":2.799,"15min":2.799},"last":1.580},{"interface":"front","average":{"1min":1.292,"5min":1.210,"15min":1.167},"min":{"1min":0.743,"5min":0.731,"15min":0.731},"max":{"1min":2.624,"5min":2.624,"15min":2.624},"last":1.626}]},{"osd":6,"last update":"Tue Dec 24 22:06:24 2019","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.288,"15min":1.295},"min":{"1min":0.584,"5min":0.584,"15min":0.584},"max":{"1min":1.780,"5min":3.034,"15min":3.034},"last":1.522},{"interface":"front","average":{"1min":1.255,"5min":1.269,"15min":1.249},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.162,"5min":2.370,"15min":2.370},"last":1.427}]},{"osd":7,"last update":"Tue Dec 24 22:06:43 2019","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.246,"15min":1.265},"min":{"1min":0.659,"5min":0.659,"15min":0.659},"max":{"1min":1.781,"5min":2.294,"15min":2.294},"last":1.609},{"interface":"front","average":{"1min":1.419,"5min":1.508,"15min":1.489},"min":{"1min":0.771,"5min":0.707,"15min":0.707},"max":{"1min":2.240,"5min":3.368,"15min":3.368},"last":1.660}]},{"osd":8,"last update":"Tue Dec 24 22:05:54 2019","interfaces":[{"interface":"back","average":{"1min":1.580,"5min":1.690,"15min":1.708},"min":{"1min":0.639,"5min":0.639,"15min":0.639},"max":{"1min":3.927,"5min":3.927,"15min":3.927},"last":1.769},{"interface":"front","average":{"1min":1.308,"5min":1.380,"15min":1.392},"min":{"1min":0.785,"5min":0.785,"15min":0.785},"max":{"1min":2.430,"5min":2.430,"15min":2.430},"last":1.472}]},{"osd":9,"last update":"Tue Dec 24 22:06:18 2019","interfaces":[{"interface":"back","average":{"1min":1.445,"5min":1.745,"15min":1.795},"min":{"1min":0.807,"5min":0.807,"15min":0.807},"max":{"1min":2.316,"5min":3.583,"15min":3.583},"last":1.922},{"interface":"front","average":{"1min":1.294,"5min":1.530,"15min":1.569},"min":{"1min":0.600,"5min":0.600,"15min":0.600},"max":{"1min":1.936,"5min":2.914,"15min":2.914},"last":1.448}]},{"osd":10,"last update":"Tue Dec 24 22:06:37 2019","interfaces":[{"interface":"back","average":{"1min":1.667,"5min":1.823,"15min":1.849},"min":{"1min":0.929,"5min":0.929,"15min":0.929},"max":{"1min":2.454,"5min":3.759,"15min":3.759},"last":1.964},{"interface":"front","average":{"1min":1.447,"5min":1.547,"15min":1.563},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.136,"5min":3.187,"15min":3.187},"last":1.739}]},{"osd":11,"last update":"Tue Dec 24 22:05:54 2019","interfaces":[{"interface":"back","average":{"1min":1.666,"5min":1.666,"15min":1.666},"min":{"1min":1.074,"5min":1.074,"15min":1.074},"max":{"1min":2.540,"5min":2.540,"15min":2.540},"last":1.820},{"interface":"front","average":{"1min":1.602,"5min":1.602,"15min":1.602},"min":{"1min":0.866,"5min":0.866,"15min":0.866},"max":{"1min":4.079,"5min":4.079,"15min":4.079},"last":1.688}]}]},{"osd":4,"up_from":27,"seq":115964117048,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049256,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695896,"statfs":{"total":95995035648,"available":94920597504,"internally_reserved":1073741824,"allocated":688128,"data_stored":348973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:06:37 2019","interfaces":[{"interface":"back","average":{"1min":1.029,"5min":1.011,"15min":0.933},"min":{"1min":0.587,"5min":0.441,"15min":0.441},"max":{"1min":1.601,"5min":2.050,"15min":2.050},"last":2.593},{"interface":"front","average":{"1min":0.904,"5min":1.014,"15min":1.067},"min":{"1min":0.555,"5min":0.555,"15min":0.555},"max":{"1min":1.341,"5min":1.653,"15min":1.653},"last":1.720}]},{"osd":1,"last update":"Tue Dec 24 22:06:37 2019","interfaces":[{"interface":"back","average":{"1min":0.803,"5min":0.890,"15min":0.896},"min":{"1min":0.587,"5min":0.587,"15min":0.587},"max":{"1min":0.983,"5min":1.795,"15min":1.795},"last":1.561},{"interface":"front","average":{"1min":1.177,"5min":1.194,"15min":1.152},"min":{"1min":0.699,"5min":0.574,"15min":0.574},"max":{"1min":1.560,"5min":2.229,"15min":2.229},"last":1.803}]},{"osd":2,"last update":"Tue Dec 24 22:06:37 2019","interfaces":[{"interface":"back","average":{"1min":0.950,"5min":1.002,"15min":0.953},"min":{"1min":0.531,"5min":0.531,"15min":0.531},"max":{"1min":1.370,"5min":2.144,"15min":2.144},"last":1.635},{"interface":"front","average":{"1min":1.062,"5min":1.050,"15min":1.050},"min":{"1min":0.817,"5min":0.564,"15min":0.564},"max":{"1min":1.518,"5min":1.821,"15min":1.821},"last":1.927}]},{"osd":3,"last update":"Tue Dec 24 22:06:37 2019","interfaces":[{"interface":"back","average":{"1min":1.240,"5min":1.164,"15min":1.081},"min":{"1min":0.724,"5min":0.637,"15min":0.637},"max":{"1min":1.701,"5min":1.799,"15min":1.799},"last":2.077},{"interface":"front","average":{"1min":1.252,"5min":1.106,"15min":0.990},"min":{"1min":0.981,"5min":0.585,"15min":0.585},"max":{"1min":1.536,"5min":1.852,"15min":1.852},"last":2.025}]},{"osd":5,"last update":"Tue Dec 24 22:06:09 2019","interfaces":[{"interface":"back","average":{"1min":1.251,"5min":1.132,"15min":1.055},"min":{"1min":0.645,"5min":0.510,"15min":0.510},"max":{"1min":1.773,"5min":2.081,"15min":2.081},"last":2.379},{"interface":"front","average":{"1min":1.165,"5min":1.131,"15min":1.125},"min":{"1min":0.644,"5min":0.557,"15min":0.557},"max":{"1min":1.601,"5min":2.611,"15min":2.611},"last":2.151}]},{"osd":6,"last update":"Tue Dec 24 22:06:20 2019","interfaces":[{"interface":"back","average":{"1min":1.443,"5min":1.333,"15min":1.281},"min":{"1min":0.785,"5min":0.576,"15min":0.576},"max":{"1min":1.967,"5min":2.028,"15min":2.028},"last":3.623},{"interface":"front","average":{"1min":0.996,"5min":1.116,"15min":1.133},"min":{"1min":0.610,"5min":0.610,"15min":0.610},"max":{"1min":1.486,"5min":2.187,"15min":2.187},"last":1.767}]},{"osd":7,"last update":"Tue Dec 24 22:06:42 2019","interfaces":[{"interface":"back","average":{"1min":1.487,"5min":1.379,"15min":1.374},"min":{"1min":0.894,"5min":0.663,"15min":0.663},"max":{"1min":2.006,"5min":2.006,"15min":2.006},"last":3.537},{"interface":"front","average":{"1min":1.306,"5min":1.333,"15min":1.341},"min":{"1min":0.889,"5min":0.889,"15min":0.889},"max":{"1min":1.684,"5min":2.336,"15min":2.336},"last":2.503}]},{"osd":8,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.692,"5min":1.742,"15min":1.750},"min":{"1min":1.262,"5min":1.245,"15min":1.245},"max":{"1min":2.341,"5min":2.341,"15min":2.341},"last":3.740},{"interface":"front","average":{"1min":1.638,"5min":1.622,"15min":1.619},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":3.360}]},{"osd":9,"last update":"Tue Dec 24 22:06:13 2019","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.442,"15min":1.454},"min":{"1min":0.961,"5min":0.946,"15min":0.946},"max":{"1min":1.764,"5min":1.827,"15min":1.827},"last":2.318},{"interface":"front","average":{"1min":1.826,"5min":1.770,"15min":1.760},"min":{"1min":1.249,"5min":1.249,"15min":1.249},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":3.890}]},{"osd":10,"last update":"Tue Dec 24 22:06:37 2019","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.524,"15min":1.550},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.607,"5min":1.902,"15min":1.902},"last":2.209},{"interface":"front","average":{"1min":1.838,"5min":1.882,"15min":1.889},"min":{"1min":1.456,"5min":1.447,"15min":1.447},"max":{"1min":2.175,"5min":2.356,"15min":2.356},"last":3.946}]}]},{"osd":5,"up_from":32,"seq":137438953524,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049268,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695884,"statfs":{"total":95995035648,"available":94920585216,"internally_reserved":1073741824,"allocated":700416,"data_stored":356056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 24 22:06:06 2019","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.888,"15min":0.830},"min":{"1min":0.630,"5min":0.466,"15min":0.466},"max":{"1min":2.180,"5min":2.180,"15min":2.180},"last":0.995},{"interface":"front","average":{"1min":1.187,"5min":1.031,"15min":0.982},"min":{"1min":0.796,"5min":0.613,"15min":0.613},"max":{"1min":2.320,"5min":2.320,"15min":2.320},"last":1.094}]},{"osd":1,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.057,"5min":1.069,"15min":1.075},"min":{"1min":0.554,"5min":0.554,"15min":0.554},"max":{"1min":1.864,"5min":1.864,"15min":1.864},"last":0.885},{"interface":"front","average":{"1min":1.133,"5min":1.140,"15min":1.136},"min":{"1min":0.601,"5min":0.601,"15min":0.601},"max":{"1min":3.438,"5min":3.438,"15min":3.438},"last":1.166}]},{"osd":2,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.158,"5min":1.122,"15min":1.120},"min":{"1min":0.527,"5min":0.527,"15min":0.527},"max":{"1min":2.248,"5min":2.248,"15min":2.248},"last":1.297},{"interface":"front","average":{"1min":1.212,"5min":1.238,"15min":1.219},"min":{"1min":0.579,"5min":0.579,"15min":0.579},"max":{"1min":2.000,"5min":2.000,"15min":2.000},"last":1.354}]},{"osd":3,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.160,"15min":1.102},"min":{"1min":0.850,"5min":0.680,"15min":0.680},"max":{"1min":2.328,"5min":2.328,"15min":2.328},"last":1.426},{"interface":"front","average":{"1min":1.263,"5min":1.299,"15min":1.283},"min":{"1min":0.611,"5min":0.611,"15min":0.611},"max":{"1min":2.056,"5min":2.143,"15min":2.143},"last":1.490}]},{"osd":4,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":0.834,"5min":0.944,"15min":0.970},"min":{"1min":0.557,"5min":0.549,"15min":0.549},"max":{"1min":1.558,"5min":1.878,"15min":1.878},"last":1.254},{"interface":"front","average":{"1min":1.168,"5min":1.020,"15min":0.956},"min":{"1min":0.581,"5min":0.578,"15min":0.578},"max":{"1min":2.106,"5min":2.106,"15min":2.106},"last":1.705}]},{"osd":6,"last update":"Tue Dec 24 22:06:16 2019","interfaces":[{"interface":"back","average":{"1min":1.152,"5min":1.307,"15min":1.333},"min":{"1min":0.630,"5min":0.630,"15min":0.630},"max":{"1min":1.748,"5min":2.045,"15min":2.045},"last":1.923},{"interface":"front","average":{"1min":0.953,"5min":1.054,"15min":1.082},"min":{"1min":0.634,"5min":0.634,"15min":0.634},"max":{"1min":1.731,"5min":1.998,"15min":1.998},"last":1.054}]},{"osd":7,"last update":"Tue Dec 24 22:06:36 2019","interfaces":[{"interface":"back","average":{"1min":1.394,"5min":1.422,"15min":1.430},"min":{"1min":0.829,"5min":0.829,"15min":0.829},"max":{"1min":2.007,"5min":2.235,"15min":2.235},"last":1.598},{"interface":"front","average":{"1min":1.459,"5min":1.565,"15min":1.587},"min":{"1min":0.774,"5min":0.706,"15min":0.706},"max":{"1min":2.164,"5min":2.164,"15min":2.164},"last":2.130}]},{"osd":8,"last update":"Tue Dec 24 22:05:55 2019","interfaces":[{"interface":"back","average":{"1min":1.646,"5min":1.766,"15min":1.786},"min":{"1min":0.986,"5min":0.986,"15min":0.986},"max":{"1min":2.702,"5min":2.702,"15min":2.702},"last":1.859},{"interface":"front","average":{"1min":1.638,"5min":1.821,"15min":1.851},"min":{"1min":0.939,"5min":0.939,"15min":0.939},"max":{"1min":2.224,"5min":2.386,"15min":2.386},"last":2.040}]},{"osd":9,"last update":"Tue Dec 24 22:06:16 2019","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.779,"15min":1.789},"min":{"1min":1.111,"5min":1.111,"15min":1.111},"max":{"1min":2.549,"5min":2.549,"15min":2.549},"last":1.979},{"interface":"front","average":{"1min":1.708,"5min":1.823,"15min":1.842},"min":{"1min":1.159,"5min":1.159,"15min":1.159},"max":{"1min":2.493,"5min":2.493,"15min":2.493},"last":1.801}]},{"osd":10,"last update":"Tue Dec 24 22:06:34 2019","interfaces":[{"interface":"back","average":{"1min":1.765,"5min":1.741,"15min":1.737},"min":{"1min":1.348,"5min":1.214,"15min":1.214},"max":{"1min":2.553,"5min":2.640,"15min":2.640},"last":2.085},{"interface":"front","average":{"1min":1.801,"5min":1.758,"15min":1.751},"min":{"1min":1.316,"5min":1.126,"15min":1.126},"max":{"1min":2.609,"5min":2.609,"15min":2.609},"last":2.190}]}]}]}} 2019-12-24T22:06:54.389 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2019-12-24T22:06:54.390 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool set unique_pool_0 pg_num 26 2019-12-24T22:06:54.542 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:06:54.709 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:06:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:54.923 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:06:55.030 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:06:55.174 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:55.484 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:06:55.591 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:06:55.709 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:55.831 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:06:55.941 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:06:56.056 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:56.156 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:06:56.263 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:06:56.384 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:56.475 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:06:56.484 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:06:56.581 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:06:56.701 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:56.806 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:06:56.914 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:06:56.934 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:06:56.959 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:06:56.983 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:06:57.005 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:06:57.026 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:57.029 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:06:57.054 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:06:57.080 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:06:57.106 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:06:57.116 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:06:57.117 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-24T22:06:57.124 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:06:57.133 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:06:57.170 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9: {} 2019-12-24T22:06:57.205 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:06:57.230 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:06:57.242 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:06:57.244 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-24T22:06:57.244 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-24T22:06:57.244 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-24T22:06:57.245 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-24T22:06:57.245 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-24T22:06:57.245 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-24T22:06:57.245 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-24T22:06:57.245 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-24T22:06:57.245 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-24T22:06:57.245 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-24T22:06:57.246 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-24T22:06:57.246 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-24T22:06:57.343 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:57.425 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:06:57.534 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:06:57.656 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:57.756 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:06:57.863 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:06:57.985 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:58.080 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:06:58.188 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:06:58.238 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is unset 2019-12-24T22:06:58.295 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:58.366 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:06:58.471 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:06:58.608 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:59.009 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:06:59.115 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:06:59.232 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:59.330 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:06:59.437 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:06:59.558 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:06:59.672 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:06:59.781 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:06:59.936 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:00.066 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:07:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:07:00.172 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:07:00.201 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-24T22:07:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:set pool 1 pg_num to 26 2019-12-24T22:07:00.250 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:00.754 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:07:00.883 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:07:00.930 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:07:00.930 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-24T22:07:01.018 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:01.106 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-24T22:07:01.183 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:07:01.247 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_0 2019-12-24T22:07:01.247 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2019-12-24T22:07:01.342 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:07:01.460 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:01.547 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:07:01.654 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:07:01.749 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:01.942 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:07:02.061 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.9 2019-12-24T22:07:02.174 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:02.257 INFO:teuthology.orchestra.run.smithi124.stdout:4f472c8d2b7010caabd0b9a6f808a25a831297e83221fb2edb973dfe179278ce 2019-12-24T22:07:02.362 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:07:02.474 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:02.557 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:07:02.663 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:07:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:03.325 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:07:03.500 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:07:03.620 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:03.722 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:07:03.829 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:07:03.938 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:04.032 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:07:04.140 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:07:04.253 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:04.340 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:07:04.449 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:07:04.517 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:07:04.540 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:07:04.563 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:07:04.570 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:04.591 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:07:04.613 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:07:04.637 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:07:04.661 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:07:04.687 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:07:04.688 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:07:04.715 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:07:04.743 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9: {} 2019-12-24T22:07:04.769 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:07:04.794 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:07:04.800 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:07:04.800 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-24T22:07:04.800 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-24T22:07:04.800 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-24T22:07:04.800 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-24T22:07:04.801 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-24T22:07:04.801 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-24T22:07:04.801 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-24T22:07:04.801 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-24T22:07:04.801 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-24T22:07:04.801 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-24T22:07:04.801 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-24T22:07:04.802 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-24T22:07:04.906 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:05.268 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_0' removed 2019-12-24T22:07:05.331 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:07:05.399 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:07:05.506 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:07:05.627 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:05.763 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:07:05.859 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2019-12-24T22:07:05.859 INFO:tasks.radosbench:Beginning radosbench... 2019-12-24T22:07:05.859 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_1 2019-12-24T22:07:05.860 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool create unique_pool_1 16 2019-12-24T22:07:05.871 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:07:06.008 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:06.149 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:07:06.248 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] out_osds: [] dead_osds: [] live_osds: [11, 10, 1, 0, 3, 2, 5, 4, 7, 6, 9, 8] 2019-12-24T22:07:06.248 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2019-12-24T22:07:06.248 INFO:tasks.thrashosds.thrasher:Reweighting osd 4 to 0.474707048293 2019-12-24T22:07:06.249 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd reweight 4 0.474707048293 2019-12-24T22:07:06.258 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:07:06.259 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-24T22:07:06.284 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is unset 2019-12-24T22:07:06.327 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:07:06.405 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:06.925 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:07:07.061 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:07:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:07.445 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-24T22:07:07.741 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:07:07.853 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:07:07.972 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:08.080 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:07:08.185 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:07:08.299 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:08.421 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:07:08.529 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:07:08.645 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:08.748 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:07:08.855 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:07:08.971 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:08.991 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd set noscrub 2019-12-24T22:07:09.048 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:07:09.154 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:07:09.270 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:09.354 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:07:09.460 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:07:09.553 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:10.181 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_1' created 2019-12-24T22:07:10.215 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:07:10.440 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:07:10.483 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2019-12-24T22:07:10.483 INFO:teuthology.orchestra.run.smithi037.stdout: "ops": [], 2019-12-24T22:07:10.483 INFO:teuthology.orchestra.run.smithi037.stdout: "num_ops": 0 2019-12-24T22:07:10.483 INFO:teuthology.orchestra.run.smithi037.stdout:} 2019-12-24T22:07:10.532 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:10.899 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:07:11.107 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.9 2019-12-24T22:07:11.203 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.4 to 0.474707 (7986) 2019-12-24T22:07:11.221 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:11.309 INFO:teuthology.orchestra.run.smithi124.stdout:4f472c8d2b7010caabd0b9a6f808a25a831297e83221fb2edb973dfe179278ce 2019-12-24T22:07:11.360 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2019-12-24T22:07:11.411 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:07:11.499 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:12.199 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:07:12.225 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-24T22:07:12.312 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:07:12.341 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:07:12.342 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:07:12.342 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:07:12.360 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:07:12.385 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:07:12.386 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:12.431 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:07:12.457 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:07:12.483 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:07:12.498 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:07:12.509 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:07:12.534 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9: {} 2019-12-24T22:07:12.570 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:07:12.602 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:07:12.605 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-24T22:07:12.606 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-24T22:07:12.606 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-24T22:07:12.606 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-24T22:07:12.606 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-24T22:07:12.606 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-24T22:07:12.606 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-24T22:07:12.607 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-24T22:07:12.607 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-24T22:07:12.607 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-24T22:07:12.607 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-24T22:07:12.607 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-24T22:07:12.658 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:07:12.767 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:13.057 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:07:13.179 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:07:13.294 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:13.396 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:07:13.504 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:07:13.633 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:14.231 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:07:14.377 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:07:14.492 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:14.622 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:07:14.730 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:07:14.850 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:14.937 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:07:15.044 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:07:15.088 INFO:teuthology.orchestra.run.smithi037.stdout:ERROR: (22) Invalid argument 2019-12-24T22:07:15.164 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:15.238 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is set 2019-12-24T22:07:15.721 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-24T22:07:15.781 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:07:15.902 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-24T22:07:15.989 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:07:16.104 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:16.188 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:07:16.245 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rados' on pool 'unique_pool_1' 2019-12-24T22:07:16.296 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.9 2019-12-24T22:07:16.419 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:16.531 INFO:teuthology.orchestra.run.smithi124.stdout:4f472c8d2b7010caabd0b9a6f808a25a831297e83221fb2edb973dfe179278ce 2019-12-24T22:07:16.639 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:07:16.757 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:16.845 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:07:16.953 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:07:17.069 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:17.147 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:07:17.228 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] out_osds: [] dead_osds: [] live_osds: [11, 10, 1, 0, 3, 2, 5, 4, 7, 6, 9, 8] 2019-12-24T22:07:17.228 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2019-12-24T22:07:17.229 INFO:tasks.thrashosds.thrasher:Setting osd 8 primary_affinity to 1.000000 2019-12-24T22:07:17.229 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd primary-affinity 8 1 2019-12-24T22:07:17.255 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:07:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:17.453 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:07:17.559 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:07:17.683 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:17.786 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:07:17.893 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.9 2019-12-24T22:07:17.991 INFO:teuthology.orchestra.run.smithi124:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.2 -b 65536 -O 65536 -p unique_pool_1 bench 90 write' 2019-12-24T22:07:17.994 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2019-12-24T22:07:17.995 INFO:teuthology.orchestra.run:waiting for 3000 2019-12-24T22:07:18.007 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:18.074 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-24T22:07:18.080 INFO:teuthology.orchestra.run.smithi124.stdout:4f472c8d2b7010caabd0b9a6f808a25a831297e83221fb2edb973dfe179278ce 2019-12-24T22:07:18.160 INFO:tasks.radosbench.radosbench.2.smithi124.stderr:unrecognized command -O; -h or --help for usage 2019-12-24T22:07:18.161 INFO:tasks.radosbench.radosbench.2.smithi124.stderr:error 22: (22) Invalid argument 2019-12-24T22:07:18.185 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:07:18.261 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:18.330 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:07:18.436 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:07:18.564 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:18.670 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:07:18.757 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:07:18.778 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:07:18.796 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:07:18.833 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:07:18.856 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:07:18.881 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:07:18.893 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:18.910 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:07:18.935 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:07:18.960 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:07:18.986 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:07:19.020 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9: {} 2019-12-24T22:07:19.035 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:07:19.059 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:07:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-24T22:07:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-24T22:07:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-24T22:07:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-24T22:07:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-24T22:07:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-24T22:07:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-24T22:07:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-24T22:07:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-24T22:07:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-24T22:07:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-24T22:07:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-24T22:07:19.149 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2019-12-24T22:07:19.150 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 20, 2019-12-24T22:07:19.150 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 600, 2019-12-24T22:07:19.150 INFO:teuthology.orchestra.run.smithi037.stdout: "ops": [ 2019-12-24T22:07:19.150 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:07:19.150 INFO:teuthology.orchestra.run.smithi037.stdout: "description": "MOSDScrubReserve(1.3 GRANT e91)", 2019-12-24T22:07:19.150 INFO:teuthology.orchestra.run.smithi037.stdout: "initiated_at": "2019-12-24T22:07:05.447552+0000", 2019-12-24T22:07:19.150 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 13.581418622999999, 2019-12-24T22:07:19.151 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0.00015546700000000001, 2019-12-24T22:07:19.151 INFO:teuthology.orchestra.run.smithi037.stdout: "type_data": { 2019-12-24T22:07:19.151 INFO:teuthology.orchestra.run.smithi037.stdout: "flag_point": "started", 2019-12-24T22:07:19.151 INFO:teuthology.orchestra.run.smithi037.stdout: "events": [ 2019-12-24T22:07:19.151 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:07:19.151 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "initiated", 2019-12-24T22:07:19.152 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.447552+0000", 2019-12-24T22:07:19.152 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0 2019-12-24T22:07:19.152 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:07:19.152 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:07:19.152 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "throttled", 2019-12-24T22:07:19.152 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.447552+0000", 2019-12-24T22:07:19.152 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 1.607e-06 2019-12-24T22:07:19.153 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:07:19.153 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:07:19.153 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "header_read", 2019-12-24T22:07:19.153 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.447553+0000", 2019-12-24T22:07:19.153 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 2.2280000000000001e-06 2019-12-24T22:07:19.153 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:07:19.153 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:07:19.153 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "all_read", 2019-12-24T22:07:19.154 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.447556+0000", 2019-12-24T22:07:19.154 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 1.2680999999999999e-05 2019-12-24T22:07:19.154 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:07:19.154 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:07:19.154 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "dispatched", 2019-12-24T22:07:19.154 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.447568+0000", 2019-12-24T22:07:19.154 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 1.6657999999999999e-05 2019-12-24T22:07:19.155 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:07:19.155 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:07:19.155 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "queued_for_pg", 2019-12-24T22:07:19.155 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.447585+0000", 2019-12-24T22:07:19.155 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 6.8787000000000004e-05 2019-12-24T22:07:19.155 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:07:19.156 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:07:19.156 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "reached_pg", 2019-12-24T22:07:19.156 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.447654+0000", 2019-12-24T22:07:19.156 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 3.0525999999999999e-05 2019-12-24T22:07:19.156 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:07:19.156 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:07:19.156 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "started", 2019-12-24T22:07:19.157 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.447684+0000", 2019-12-24T22:07:19.157 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 2.298e-05 2019-12-24T22:07:19.157 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:07:19.157 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:07:19.157 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "done", 2019-12-24T22:07:19.157 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.447707+0000", 2019-12-24T22:07:19.157 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0.00015546700000000001 2019-12-24T22:07:19.158 INFO:teuthology.orchestra.run.smithi037.stdout: } 2019-12-24T22:07:19.158 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2019-12-24T22:07:19.158 INFO:teuthology.orchestra.run.smithi037.stdout: } 2019-12-24T22:07:19.158 INFO:teuthology.orchestra.run.smithi037.stdout: } 2019-12-24T22:07:19.158 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2019-12-24T22:07:19.158 INFO:teuthology.orchestra.run.smithi037.stdout:} 2019-12-24T22:07:19.366 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:07:19.489 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:07:19.608 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:19.703 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:07:19.811 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:07:19.932 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-24T22:07:19.941 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:20.273 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:07:20.380 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:07:20.495 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:20.571 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:07:20.677 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:07:20.797 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:20.886 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:07:20.994 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:07:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:21.387 INFO:teuthology.orchestra.run.smithi037.stderr:set osd.8 primary-affinity to 1 (8655362) 2019-12-24T22:07:21.397 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:07:21.503 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:07:21.623 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:21.710 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:07:21.811 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:07:21.928 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:22.005 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:07:22.110 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:07:22.227 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-24T22:07:22.277 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:22.406 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is set 2019-12-24T22:07:22.506 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:07:22.613 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:07:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:22.970 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:07:23.277 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:07:23.450 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:23.887 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2019-12-24T22:07:23.888 INFO:teuthology.orchestra.run.smithi037.stdout: "ops": [], 2019-12-24T22:07:23.888 INFO:teuthology.orchestra.run.smithi037.stdout: "num_ops": 0 2019-12-24T22:07:23.888 INFO:teuthology.orchestra.run.smithi037.stdout:} 2019-12-24T22:07:23.941 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:07:24.049 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:07:24.095 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_1 2019-12-24T22:07:24.096 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2019-12-24T22:07:24.180 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:24.398 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:07:24.490 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-24T22:07:24.570 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:07:24.691 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:24.785 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:07:24.893 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:07:25.017 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:25.053 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:07:25.080 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:07:25.105 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:07:25.125 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:07:25.127 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:07:25.153 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:07:25.178 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:07:25.203 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:07:25.228 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:07:25.230 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:07:25.258 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:07:25.283 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9: {} 2019-12-24T22:07:25.308 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:07:25.341 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:07:25.342 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:25.343 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-24T22:07:25.343 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-24T22:07:25.343 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-24T22:07:25.343 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-24T22:07:25.343 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-24T22:07:25.343 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-24T22:07:25.344 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-24T22:07:25.344 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-24T22:07:25.344 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-24T22:07:25.344 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-24T22:07:25.344 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-24T22:07:25.344 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-24T22:07:25.421 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:07:25.431 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd unset noscrub 2019-12-24T22:07:25.526 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:07:25.632 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:25.721 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:07:25.828 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:07:25.950 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:26.314 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:07:26.434 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:07:26.556 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:26.644 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:07:26.751 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:07:26.876 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:26.985 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:07:27.092 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.9 2019-12-24T22:07:27.206 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:27.271 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] out_osds: [] dead_osds: [] live_osds: [11, 10, 1, 0, 3, 2, 5, 4, 7, 6, 9, 8] 2019-12-24T22:07:27.272 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2019-12-24T22:07:27.272 INFO:tasks.thrashosds.thrasher:Removing osd 5, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] 2019-12-24T22:07:27.272 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd out 5 2019-12-24T22:07:27.313 INFO:teuthology.orchestra.run.smithi124.stdout:4f472c8d2b7010caabd0b9a6f808a25a831297e83221fb2edb973dfe179278ce 2019-12-24T22:07:27.419 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:07:27.502 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_1' removed 2019-12-24T22:07:27.677 INFO:teuthology.orchestra.run.smithi037.stdout:ERROR: (22) Invalid argument 2019-12-24T22:07:27.904 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:07:28.015 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:07:28.134 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:28.496 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-24T22:07:28.756 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:07:29.025 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:07:29.074 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-24T22:07:29.089 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2019-12-24T22:07:29.090 INFO:tasks.radosbench:Beginning radosbench... 2019-12-24T22:07:29.090 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_2 2019-12-24T22:07:29.090 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool create unique_pool_2 16 2019-12-24T22:07:29.168 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:29.396 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:07:29.680 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:07:29.799 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:30.196 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:07:30.309 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:07:30.460 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:31.196 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is unset 2019-12-24T22:07:31.479 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:07:31.597 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:07:31.710 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:31.795 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:07:31.901 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.9 2019-12-24T22:07:31.925 INFO:ceph.mon.a.smithi037.stdout:2019-12-24T22:07:31.846+0000 7f6c3fbfd700 -1 mon.a@0(leader).osd e106 definitely_dead 0 2019-12-24T22:07:32.015 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:32.111 INFO:teuthology.orchestra.run.smithi124.stdout:4f472c8d2b7010caabd0b9a6f808a25a831297e83221fb2edb973dfe179278ce 2019-12-24T22:07:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:marked out osd.5. 2019-12-24T22:07:32.218 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:07:32.309 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:32.386 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:07:32.492 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:07:32.606 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:32.703 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:07:32.810 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:07:32.928 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:33.018 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:07:33.125 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:07:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:33.512 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:07:33.618 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:07:33.705 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:33.733 INFO:teuthology.orchestra.run.smithi037.stdout:ERROR: (22) Invalid argument 2019-12-24T22:07:33.777 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:07:33.799 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:07:33.822 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:07:33.843 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:07:33.865 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:07:33.881 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:07:33.891 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:07:33.916 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:07:33.941 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:07:33.966 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:07:33.970 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:34.188 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_2' created 2019-12-24T22:07:34.204 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:07:34.224 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:07:34.265 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9: {} 2019-12-24T22:07:34.301 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:07:34.334 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:07:34.336 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-24T22:07:34.337 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-24T22:07:34.337 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-24T22:07:34.337 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-24T22:07:34.337 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-24T22:07:34.337 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-24T22:07:34.337 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-24T22:07:34.337 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-24T22:07:34.338 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-24T22:07:34.338 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-24T22:07:34.338 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-24T22:07:34.338 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-24T22:07:34.387 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-24T22:07:34.447 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:07:34.527 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:34.689 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:07:34.884 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:07:34.887 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-24T22:07:34.898 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2019-12-24T22:07:35.000 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:35.078 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:07:35.184 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:07:35.293 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:35.401 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:07:35.508 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:07:35.621 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:35.701 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:07:35.807 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:07:35.922 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:36.446 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:07:36.553 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:07:36.666 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:36.767 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:07:36.874 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:07:36.991 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:37.084 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:07:37.191 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:07:37.312 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:37.417 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:07:37.469 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-24T22:07:37.498 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2019-12-24T22:07:37.498 INFO:teuthology.orchestra.run.smithi037.stdout: "ops": [], 2019-12-24T22:07:37.498 INFO:teuthology.orchestra.run.smithi037.stdout: "num_ops": 0 2019-12-24T22:07:37.499 INFO:teuthology.orchestra.run.smithi037.stdout:} 2019-12-24T22:07:37.525 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:07:37.603 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:37.771 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:07:37.904 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:07:38.019 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:38.102 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:07:38.169 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 6, 7, 8, 9, 10, 11] out_osds: [5] dead_osds: [] live_osds: [11, 10, 1, 0, 3, 2, 5, 4, 7, 6, 9, 8] 2019-12-24T22:07:38.169 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2019-12-24T22:07:38.169 INFO:tasks.thrashosds.thrasher:Setting osd 9 primary_affinity to 0.128213 2019-12-24T22:07:38.170 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd primary-affinity 9 0.128212728415 2019-12-24T22:07:38.208 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:07:38.303 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:38.459 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-24T22:07:38.478 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:07:38.585 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:07:38.702 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:38.769 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:07:38.876 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.9 2019-12-24T22:07:38.990 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:39.102 INFO:teuthology.orchestra.run.smithi124.stdout:4f472c8d2b7010caabd0b9a6f808a25a831297e83221fb2edb973dfe179278ce 2019-12-24T22:07:39.197 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rados' on pool 'unique_pool_2' 2019-12-24T22:07:39.198 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is unset 2019-12-24T22:07:39.209 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.9 2019-12-24T22:07:39.313 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:39.385 INFO:teuthology.orchestra.run.smithi124.stdout:4f472c8d2b7010caabd0b9a6f808a25a831297e83221fb2edb973dfe179278ce 2019-12-24T22:07:39.491 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:07:39.654 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:40.630 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:07:40.939 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:07:41.085 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:41.187 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:07:41.363 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:07:41.450 INFO:teuthology.orchestra.run.smithi124:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.2 -b 65536 -O 65536 -p unique_pool_2 bench 90 write' 2019-12-24T22:07:41.454 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2019-12-24T22:07:41.455 INFO:teuthology.orchestra.run:waiting for 3000 2019-12-24T22:07:41.480 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:41.568 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:07:41.616 INFO:tasks.radosbench.radosbench.2.smithi124.stderr:unrecognized command -O; -h or --help for usage 2019-12-24T22:07:41.616 INFO:tasks.radosbench.radosbench.2.smithi124.stderr:error 22: (22) Invalid argument 2019-12-24T22:07:41.673 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:07:41.789 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:41.813 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:07:41.837 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:07:41.861 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:07:41.868 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:07:41.886 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:07:41.913 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:07:41.937 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:07:41.963 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:07:41.976 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:07:41.988 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:07:42.019 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:07:42.044 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9: {} 2019-12-24T22:07:42.069 INFO:teuthology.orchestra.run.smithi037.stdout:ERROR: (22) Invalid argument 2019-12-24T22:07:42.069 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:07:42.085 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:42.094 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:07:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-24T22:07:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-24T22:07:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-24T22:07:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-24T22:07:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-24T22:07:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-24T22:07:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-24T22:07:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-24T22:07:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-24T22:07:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-24T22:07:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-24T22:07:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-24T22:07:42.225 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:07:42.333 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:07:42.449 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:42.516 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:07:42.623 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:07:42.739 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:42.755 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-24T22:07:42.818 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:07:42.924 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:07:43.033 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:43.110 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:07:43.126 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd set noscrub 2019-12-24T22:07:43.215 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:07:43.217 INFO:teuthology.orchestra.run.smithi037.stderr:set osd.9 primary-affinity to 0.128213 (884022) 2019-12-24T22:07:43.319 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:43.408 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:07:43.515 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:07:43.635 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:43.725 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:07:43.832 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:07:43.945 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:44.319 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:07:44.435 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:07:44.562 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:44.912 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-24T22:07:44.954 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:07:45.068 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:07:45.151 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:45.261 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:07:45.264 INFO:teuthology.orchestra.run.smithi037.stdout:ERROR: (22) Invalid argument 2019-12-24T22:07:45.472 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:07:45.592 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:45.676 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:07:45.783 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:07:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:46.162 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:07:46.267 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-24T22:07:46.269 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:07:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:46.499 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:07:46.607 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:07:46.718 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:07:46.926 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:07:47.039 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:47.118 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:07:47.224 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:07:47.243 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is set 2019-12-24T22:07:47.339 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:47.433 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:07:47.540 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:07:47.555 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_2 2019-12-24T22:07:47.556 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2019-12-24T22:07:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:47.768 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:07:47.768 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:07:47.777 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:07:47.806 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:07:47.831 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:07:47.855 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:07:47.879 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:07:47.915 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:07:47.944 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:07:47.972 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9: {} 2019-12-24T22:07:48.002 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:07:48.002 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:07:48.022 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:07:48.023 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-24T22:07:48.023 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-24T22:07:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-24T22:07:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-24T22:07:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-24T22:07:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-24T22:07:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-24T22:07:48.025 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-24T22:07:48.025 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-24T22:07:48.025 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-24T22:07:48.025 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-24T22:07:48.025 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-24T22:07:48.197 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:07:48.316 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:48.408 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:07:48.515 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:07:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:48.741 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:07:48.849 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:07:48.962 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 6, 7, 8, 9, 10, 11] out_osds: [5] dead_osds: [] live_osds: [11, 10, 1, 0, 3, 2, 5, 4, 7, 6, 9, 8] 2019-12-24T22:07:48.963 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2019-12-24T22:07:48.963 INFO:tasks.thrashosds.thrasher:Killing osd 9, live_osds are [11, 10, 1, 0, 3, 2, 5, 4, 7, 6, 9, 8] 2019-12-24T22:07:48.963 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2019-12-24T22:07:48.963 INFO:teuthology.orchestra.run.smithi124:> sudo systemctl stop ceph-4a02c23c-2698-11ea-8286-001a4aab830c@osd.9 2019-12-24T22:07:48.967 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:49.042 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:07:49.148 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:07:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:49.367 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2019-12-24T22:07:49.367 INFO:teuthology.orchestra.run.smithi037.stdout: "ops": [], 2019-12-24T22:07:49.368 INFO:teuthology.orchestra.run.smithi037.stdout: "num_ops": 0 2019-12-24T22:07:49.368 INFO:teuthology.orchestra.run.smithi037.stdout:} 2019-12-24T22:07:49.406 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:07:49.510 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:07:49.627 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:49.724 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:07:49.833 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:07:49.982 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:49.988 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-24T22:07:50.110 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:07:50.216 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:07:50.225 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-24T22:07:50.348 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:50.418 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:07:50.525 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:07:50.643 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:50.780 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:07:50.888 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:07:50.965 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-24T22:07:51.019 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:51.093 INFO:tasks.cephadm.osd.9:Stopped osd.9 2019-12-24T22:07:51.093 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd 2019-12-24T22:07:51.093 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph-objectstore-tool --data-path '/var/lib/ceph/osd/ceph-{id}' --journal-path '/var/lib/ceph/osd/ceph-{id}/journal' --log-file '/var/log/ceph/objectstore_tool.\$pid.log' --op list-pgs 2019-12-24T22:07:51.109 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:07:51.215 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:07:51.263 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_2' removed 2019-12-24T22:07:51.329 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:51.407 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:07:51.514 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:07:51.661 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:52.050 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:07:52.346 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:07:52.488 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:52.595 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2019-12-24T22:07:52.596 INFO:tasks.radosbench:Beginning radosbench... 2019-12-24T22:07:52.596 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_3 2019-12-24T22:07:52.596 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool create unique_pool_3 16 2019-12-24T22:07:52.661 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:07:52.769 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:07:52.851 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:53.070 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2019-12-24T22:07:53.070 INFO:teuthology.orchestra.run.smithi037.stdout: "ops": [], 2019-12-24T22:07:53.070 INFO:teuthology.orchestra.run.smithi037.stdout: "complaint_time": 30, 2019-12-24T22:07:53.071 INFO:teuthology.orchestra.run.smithi037.stdout: "num_blocked_ops": 0 2019-12-24T22:07:53.071 INFO:teuthology.orchestra.run.smithi037.stdout:} 2019-12-24T22:07:54.190 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is set 2019-12-24T22:07:54.502 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:07:54.611 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:07:54.731 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:54.823 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-24T22:07:54.840 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:07:54.948 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:07:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:55.148 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:07:55.254 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:07:55.399 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:55.553 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:07:55.711 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:07:55.734 INFO:teuthology.orchestra.run.smithi037.stderr:Can't specify both --op and object command syntax 2019-12-24T22:07:55.734 INFO:teuthology.orchestra.run.smithi037.stderr: 2019-12-24T22:07:55.734 INFO:teuthology.orchestra.run.smithi037.stderr:Allowed options: 2019-12-24T22:07:55.734 INFO:teuthology.orchestra.run.smithi037.stderr: --help produce help message 2019-12-24T22:07:55.735 INFO:teuthology.orchestra.run.smithi037.stderr: --type arg Arg is one of [bluestore (default), filestore, 2019-12-24T22:07:55.735 INFO:teuthology.orchestra.run.smithi037.stderr: memstore] 2019-12-24T22:07:55.735 INFO:teuthology.orchestra.run.smithi037.stderr: --data-path arg path to object store, mandatory 2019-12-24T22:07:55.735 INFO:teuthology.orchestra.run.smithi037.stderr: --journal-path arg path to journal, use if tool can't find it 2019-12-24T22:07:55.735 INFO:teuthology.orchestra.run.smithi037.stderr: --pgid arg PG id, mandatory for info, log, remove, export, 2019-12-24T22:07:55.735 INFO:teuthology.orchestra.run.smithi037.stderr: export-remove, mark-complete, trim-pg-log, and 2019-12-24T22:07:55.735 INFO:teuthology.orchestra.run.smithi037.stderr: mandatory for apply-layout-settings if --pool is 2019-12-24T22:07:55.736 INFO:teuthology.orchestra.run.smithi037.stderr: not specified 2019-12-24T22:07:55.736 INFO:teuthology.orchestra.run.smithi037.stderr: --pool arg Pool name, mandatory for apply-layout-settings if 2019-12-24T22:07:55.736 INFO:teuthology.orchestra.run.smithi037.stderr: --pgid is not specified 2019-12-24T22:07:55.736 INFO:teuthology.orchestra.run.smithi037.stderr: --op arg Arg is one of [info, log, remove, mkfs, fsck, 2019-12-24T22:07:55.736 INFO:teuthology.orchestra.run.smithi037.stderr: repair, fuse, dup, export, export-remove, import, 2019-12-24T22:07:55.736 INFO:teuthology.orchestra.run.smithi037.stderr: list, list-slow-omap, fix-lost, list-pgs, 2019-12-24T22:07:55.737 INFO:teuthology.orchestra.run.smithi037.stderr: dump-journal, dump-super, meta-list, get-osdmap, 2019-12-24T22:07:55.737 INFO:teuthology.orchestra.run.smithi037.stderr: set-osdmap, get-inc-osdmap, set-inc-osdmap, 2019-12-24T22:07:55.737 INFO:teuthology.orchestra.run.smithi037.stderr: mark-complete, reset-last-complete, 2019-12-24T22:07:55.737 INFO:teuthology.orchestra.run.smithi037.stderr: apply-layout-settings, update-mon-db, 2019-12-24T22:07:55.737 INFO:teuthology.orchestra.run.smithi037.stderr: dump-export, trim-pg-log] 2019-12-24T22:07:55.737 INFO:teuthology.orchestra.run.smithi037.stderr: --epoch arg epoch# for get-osdmap and get-inc-osdmap, the 2019-12-24T22:07:55.737 INFO:teuthology.orchestra.run.smithi037.stderr: current epoch in use if not specified 2019-12-24T22:07:55.738 INFO:teuthology.orchestra.run.smithi037.stderr: --file arg path of file to export, export-remove, import, 2019-12-24T22:07:55.738 INFO:teuthology.orchestra.run.smithi037.stderr: get-osdmap, set-osdmap, get-inc-osdmap or 2019-12-24T22:07:55.738 INFO:teuthology.orchestra.run.smithi037.stderr: set-inc-osdmap 2019-12-24T22:07:55.738 INFO:teuthology.orchestra.run.smithi037.stderr: --mon-store-path arg path of monstore to update-mon-db 2019-12-24T22:07:55.738 INFO:teuthology.orchestra.run.smithi037.stderr: --fsid arg fsid for new store created by mkfs 2019-12-24T22:07:55.738 INFO:teuthology.orchestra.run.smithi037.stderr: --target-data-path arg path of target object store (for --op dup) 2019-12-24T22:07:55.738 INFO:teuthology.orchestra.run.smithi037.stderr: --mountpoint arg fuse mountpoint 2019-12-24T22:07:55.739 INFO:teuthology.orchestra.run.smithi037.stderr: --format arg (=json-pretty) Output format which may be json, json-pretty, 2019-12-24T22:07:55.739 INFO:teuthology.orchestra.run.smithi037.stderr: xml, xml-pretty 2019-12-24T22:07:55.739 INFO:teuthology.orchestra.run.smithi037.stderr: --debug Enable diagnostic output to stderr 2019-12-24T22:07:55.739 INFO:teuthology.orchestra.run.smithi037.stderr: --no-mon-config Do not contact mons for config 2019-12-24T22:07:55.739 INFO:teuthology.orchestra.run.smithi037.stderr: --no-superblock Do not read superblock 2019-12-24T22:07:55.739 INFO:teuthology.orchestra.run.smithi037.stderr: --force Ignore some types of errors and proceed with 2019-12-24T22:07:55.739 INFO:teuthology.orchestra.run.smithi037.stderr: operation - USE WITH CAUTION: CORRUPTION POSSIBLE 2019-12-24T22:07:55.740 INFO:teuthology.orchestra.run.smithi037.stderr: NOW OR IN THE FUTURE 2019-12-24T22:07:55.740 INFO:teuthology.orchestra.run.smithi037.stderr: --skip-journal-replay Disable journal replay 2019-12-24T22:07:55.740 INFO:teuthology.orchestra.run.smithi037.stderr: --skip-mount-omap Disable mounting of omap 2019-12-24T22:07:55.740 INFO:teuthology.orchestra.run.smithi037.stderr: --head Find head/snapdir when searching for objects by 2019-12-24T22:07:55.740 INFO:teuthology.orchestra.run.smithi037.stderr: name 2019-12-24T22:07:55.740 INFO:teuthology.orchestra.run.smithi037.stderr: --dry-run Don't modify the objectstore 2019-12-24T22:07:55.740 INFO:teuthology.orchestra.run.smithi037.stderr: --namespace arg Specify namespace when searching for objects 2019-12-24T22:07:55.741 INFO:teuthology.orchestra.run.smithi037.stderr: --rmtype arg Specify corrupting object removal 'snapmap' or 2019-12-24T22:07:55.741 INFO:teuthology.orchestra.run.smithi037.stderr: 'nosnapmap' - TESTING USE ONLY 2019-12-24T22:07:55.741 INFO:teuthology.orchestra.run.smithi037.stderr: --slow-omap-threshold arg Threshold (in seconds) to consider omap listing 2019-12-24T22:07:55.741 INFO:teuthology.orchestra.run.smithi037.stderr: slow (for op=list-slow-omap) 2019-12-24T22:07:55.741 INFO:teuthology.orchestra.run.smithi037.stderr: 2019-12-24T22:07:55.741 INFO:teuthology.orchestra.run.smithi037.stderr: 2019-12-24T22:07:55.741 INFO:teuthology.orchestra.run.smithi037.stderr:Positional syntax: 2019-12-24T22:07:55.742 INFO:teuthology.orchestra.run.smithi037.stderr: 2019-12-24T22:07:55.742 INFO:teuthology.orchestra.run.smithi037.stderr:ceph-objectstore-tool ... (get|set)-bytes [file] 2019-12-24T22:07:55.742 INFO:teuthology.orchestra.run.smithi037.stderr:ceph-objectstore-tool ... set-(attr|omap) [file] 2019-12-24T22:07:55.742 INFO:teuthology.orchestra.run.smithi037.stderr:ceph-objectstore-tool ... (get|rm)-(attr|omap) 2019-12-24T22:07:55.742 INFO:teuthology.orchestra.run.smithi037.stderr:ceph-objectstore-tool ... get-omaphdr 2019-12-24T22:07:55.742 INFO:teuthology.orchestra.run.smithi037.stderr:ceph-objectstore-tool ... set-omaphdr [file] 2019-12-24T22:07:55.742 INFO:teuthology.orchestra.run.smithi037.stderr:ceph-objectstore-tool ... list-attrs 2019-12-24T22:07:55.743 INFO:teuthology.orchestra.run.smithi037.stderr:ceph-objectstore-tool ... list-omap 2019-12-24T22:07:55.743 INFO:teuthology.orchestra.run.smithi037.stderr:ceph-objectstore-tool ... remove|removeall 2019-12-24T22:07:55.743 INFO:teuthology.orchestra.run.smithi037.stderr:ceph-objectstore-tool ... dump 2019-12-24T22:07:55.743 INFO:teuthology.orchestra.run.smithi037.stderr:ceph-objectstore-tool ... set-size 2019-12-24T22:07:55.743 INFO:teuthology.orchestra.run.smithi037.stderr:ceph-objectstore-tool ... clear-data-digest 2019-12-24T22:07:55.743 INFO:teuthology.orchestra.run.smithi037.stderr:ceph-objectstore-tool ... remove-clone-metadata 2019-12-24T22:07:55.743 INFO:teuthology.orchestra.run.smithi037.stderr: 2019-12-24T22:07:55.744 INFO:teuthology.orchestra.run.smithi037.stderr: can be a JSON object description as displayed 2019-12-24T22:07:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:by --op list. 2019-12-24T22:07:55.744 INFO:teuthology.orchestra.run.smithi037.stderr: can be an object name which will be looked up in all 2019-12-24T22:07:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:the OSD's PGs. 2019-12-24T22:07:55.744 INFO:teuthology.orchestra.run.smithi037.stderr: can be the empty string ('') which with a provided pgid 2019-12-24T22:07:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:specifies the pgmeta object 2019-12-24T22:07:55.744 INFO:teuthology.orchestra.run.smithi037.stderr: 2019-12-24T22:07:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:The optional [file] argument will read stdin or write stdout 2019-12-24T22:07:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:if not specified or if '-' specified. 2019-12-24T22:07:55.831 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:55.923 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:07:56.030 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:07:56.177 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:56.250 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:07:56.357 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:07:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:56.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-24T22:07:56.553 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last): File "/home/teuthworker/src/github.com_liewegas_ceph_wip-cephadm-cot/qa/tasks/ceph_manager.py", line 1000, in wrapper return func(self) File "/home/teuthworker/src/github.com_liewegas_ceph_wip-cephadm-cot/qa/tasks/ceph_manager.py", line 1130, in _do_thrash self.choose_action()() File "/home/teuthworker/src/github.com_liewegas_ceph_wip-cephadm-cot/qa/tasks/ceph_manager.py", line 287, in kill_osd format(ret=proc.exitstatus)) Exception: ceph-objectstore-tool: exp list-pgs failure with status 1 2019-12-24T22:07:56.553 ERROR:tasks.thrashosds.thrasher:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_liewegas_ceph_wip-cephadm-cot/qa/tasks/ceph_manager.py", line 988, in do_thrash self._do_thrash() File "/home/teuthworker/src/github.com_liewegas_ceph_wip-cephadm-cot/qa/tasks/ceph_manager.py", line 1000, in wrapper return func(self) File "/home/teuthworker/src/github.com_liewegas_ceph_wip-cephadm-cot/qa/tasks/ceph_manager.py", line 1130, in _do_thrash self.choose_action()() File "/home/teuthworker/src/github.com_liewegas_ceph_wip-cephadm-cot/qa/tasks/ceph_manager.py", line 287, in kill_osd format(ret=proc.exitstatus)) Exception: ceph-objectstore-tool: exp list-pgs failure with status 1 2019-12-24T22:07:56.563 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:07:56.582 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:07:56.585 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:07:56.607 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:07:56.628 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:07:56.652 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:07:56.683 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:07:56.689 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:07:56.708 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:07:56.733 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:07:56.759 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:07:56.785 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:07:56.796 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:56.811 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:07:56.812 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-24T22:07:56.813 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-24T22:07:56.813 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-24T22:07:56.813 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-24T22:07:56.813 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-24T22:07:56.813 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-24T22:07:56.813 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-24T22:07:56.814 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-24T22:07:56.814 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-24T22:07:56.814 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.9 2019-12-24T22:07:56.814 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: problem getting command descriptions from osd.9 2019-12-24T22:07:56.814 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-24T22:07:56.814 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-24T22:07:57.148 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd unset noscrub 2019-12-24T22:07:57.154 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:07:57.357 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:07:57.476 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:57.573 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:07:57.649 DEBUG:teuthology.orchestra.run:got remote process result: 6 2019-12-24T22:07:57.649 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2019-12-24T22:07:57.680 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:07:57.803 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:57.883 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:07:57.988 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:07:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:58.301 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_3' created 2019-12-24T22:07:58.530 INFO:teuthology.orchestra.run.smithi037.stdout:ERROR: (22) Invalid argument 2019-12-24T22:07:58.774 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:07:58.888 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:07:59.050 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:59.152 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2019-12-24T22:07:59.486 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:07:59.596 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:07:59.650 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-24T22:07:59.703 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-24T22:07:59.746 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:07:59.900 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:08:00.112 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:08:00.227 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:00.323 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:08:00.429 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:08:00.547 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:00.639 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:08:00.747 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:08:00.864 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:00.956 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:08:01.062 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:08:01.181 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:01.273 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:08:01.316 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is unset 2019-12-24T22:08:01.379 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:08:01.499 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:01.598 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:08:01.703 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:08:01.879 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:02.447 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:08:02.594 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:08:02.713 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:02.806 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:08:02.913 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:08:03.034 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:03.147 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:08:03.202 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:08:03.255 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:08:03.332 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rados' on pool 'unique_pool_3' 2019-12-24T22:08:03.371 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:03.449 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:08:03.464 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:08:03.488 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:08:03.509 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:08:03.531 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:08:03.554 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:08:03.571 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:08:03.617 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:08:03.663 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:08:03.675 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:03.703 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:08:03.731 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:08:03.749 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:08:03.758 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:08:03.782 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:08:03.784 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-24T22:08:03.784 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-24T22:08:03.784 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-24T22:08:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-24T22:08:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-24T22:08:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-24T22:08:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-24T22:08:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-24T22:08:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-24T22:08:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.9 2019-12-24T22:08:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: problem getting command descriptions from osd.9 2019-12-24T22:08:03.786 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-24T22:08:03.786 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-24T22:08:03.854 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:08:03.998 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:08:03.998 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-24T22:08:04.009 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:04.335 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:08:04.451 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:08:04.553 DEBUG:teuthology.orchestra.run:got remote process result: 6 2019-12-24T22:08:04.554 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2019-12-24T22:08:04.567 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:04.649 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-24T22:08:04.673 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:08:04.781 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:08:04.872 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:04.958 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:08:05.066 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:08:05.176 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:05.272 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:08:05.368 INFO:teuthology.orchestra.run.smithi124:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.2 -b 65536 -O 65536 -p unique_pool_3 bench 90 write' 2019-12-24T22:08:05.372 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2019-12-24T22:08:05.372 INFO:teuthology.orchestra.run:waiting for 3000 2019-12-24T22:08:05.378 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:08:05.527 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:05.569 INFO:tasks.radosbench.radosbench.2.smithi124.stderr:unrecognized command -O; -h or --help for usage 2019-12-24T22:08:05.569 INFO:tasks.radosbench.radosbench.2.smithi124.stderr:error 22: (22) Invalid argument 2019-12-24T22:08:05.725 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:08:05.832 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:08:05.951 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:06.520 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:08:06.555 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-24T22:08:06.578 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:08:06.761 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:08:06.885 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:06.973 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:08:07.058 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:08:07.058 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-24T22:08:07.080 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:08:07.198 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:07.297 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:08:07.403 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:08:07.522 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:07.700 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:08:07.806 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:08:07.926 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:08.022 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:08:08.130 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:08:08.189 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is unset 2019-12-24T22:08:08.246 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:08.347 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:08:08.454 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:08:08.575 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:08.680 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:08:08.787 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:08:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:09.082 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:08:09.265 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:08:09.383 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:09.508 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:08:09.616 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:08:09.735 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:09.789 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:08:09.821 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:08:09.928 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:08:10.048 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:10.148 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:08:10.254 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:08:10.362 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:08:10.371 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:10.374 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:08:10.374 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-24T22:08:10.389 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:08:10.412 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:08:10.434 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:08:10.458 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:08:10.480 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:08:10.484 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:08:10.509 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:08:10.534 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:08:10.559 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:08:10.584 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:08:10.587 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:08:10.608 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:08:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-24T22:08:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-24T22:08:10.611 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-24T22:08:10.611 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-24T22:08:10.611 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-24T22:08:10.611 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-24T22:08:10.611 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-24T22:08:10.611 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-24T22:08:10.611 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-24T22:08:10.612 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.9 2019-12-24T22:08:10.612 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: problem getting command descriptions from osd.9 2019-12-24T22:08:10.612 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-24T22:08:10.612 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-24T22:08:10.700 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:10.796 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:08:10.903 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:08:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:11.301 DEBUG:teuthology.orchestra.run:got remote process result: 6 2019-12-24T22:08:11.301 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2019-12-24T22:08:11.311 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd set noscrub 2019-12-24T22:08:11.341 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:08:11.448 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:08:11.474 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_3 2019-12-24T22:08:11.474 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2019-12-24T22:08:11.564 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:11.656 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:08:11.763 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:08:11.870 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:12.316 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:08:12.552 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:08:12.668 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:12.764 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:08:12.872 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:08:12.984 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:13.064 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:08:13.171 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:08:13.284 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:13.302 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-24T22:08:13.373 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:08:13.479 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:08:13.497 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:08:13.553 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:13.742 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:08:13.920 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:08:14.035 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:14.131 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:08:14.238 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:08:14.333 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:14.421 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:08:14.527 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:08:14.562 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:08:14.563 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-24T22:08:14.649 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:14.879 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:08:14.985 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:08:15.104 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:15.196 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:08:15.253 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is set 2019-12-24T22:08:15.301 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:08:15.421 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:15.512 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:08:15.619 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:08:15.740 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:15.864 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:08:15.972 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:08:16.129 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:16.255 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_3' removed 2019-12-24T22:08:16.501 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:08:16.621 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:08:16.779 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:17.235 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:08:17.349 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:08:17.461 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:17.517 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2019-12-24T22:08:17.517 INFO:tasks.radosbench:Beginning radosbench... 2019-12-24T22:08:17.517 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_4 2019-12-24T22:08:17.518 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool create unique_pool_4 16 2019-12-24T22:08:17.547 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:08:17.608 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:08:17.637 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:08:17.653 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:08:17.664 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:08:17.686 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:08:17.711 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:08:17.736 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:08:17.761 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:08:17.770 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:17.787 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:08:17.812 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:08:17.838 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:08:17.854 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:08:17.862 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:08:17.864 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-24T22:08:17.864 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-24T22:08:17.864 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-24T22:08:17.865 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-24T22:08:17.865 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-24T22:08:17.865 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-24T22:08:17.865 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-24T22:08:17.865 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-24T22:08:17.865 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-24T22:08:17.865 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.9 2019-12-24T22:08:17.866 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: problem getting command descriptions from osd.9 2019-12-24T22:08:17.866 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-24T22:08:17.866 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-24T22:08:17.960 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:08:17.993 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:08:18.046 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:18.123 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:08:18.229 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:08:18.348 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:18.438 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:08:18.545 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:08:18.632 DEBUG:teuthology.orchestra.run:got remote process result: 6 2019-12-24T22:08:18.633 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2019-12-24T22:08:18.665 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:18.770 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:08:18.878 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:08:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:19.042 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-24T22:08:19.080 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:08:19.080 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-24T22:08:19.164 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:08:19.350 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:08:19.465 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:19.580 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:08:19.688 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:08:19.796 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:19.880 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:08:19.986 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:08:20.107 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:20.241 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:08:20.349 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:08:20.473 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:20.634 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-24T22:08:20.748 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:08:20.852 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:08:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:21.062 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:08:21.169 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:08:21.291 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:21.297 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_4' created 2019-12-24T22:08:21.378 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:08:21.486 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:08:21.639 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:22.106 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:08:22.297 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is set 2019-12-24T22:08:22.299 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2019-12-24T22:08:22.332 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:08:22.447 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:22.538 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:08:22.644 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:08:22.788 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:23.032 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:08:23.170 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:08:23.336 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:08:23.454 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:23.546 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:08:23.653 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:08:23.818 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:23.908 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:08:23.909 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-24T22:08:23.951 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:08:24.058 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:08:24.141 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:24.614 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:08:24.731 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:08:24.731 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:08:24.731 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:08:24.732 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:08:24.732 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:08:24.732 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:08:24.732 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:08:24.732 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:08:24.732 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:08:24.733 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:08:24.733 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:08:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-24T22:08:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-24T22:08:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-24T22:08:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-24T22:08:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-24T22:08:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-24T22:08:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-24T22:08:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-24T22:08:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-24T22:08:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.9 2019-12-24T22:08:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: problem getting command descriptions from osd.9 2019-12-24T22:08:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-24T22:08:24.735 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-24T22:08:24.741 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:08:24.855 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:24.954 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:08:25.061 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:08:25.225 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:25.420 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd unset noscrub 2019-12-24T22:08:25.422 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:08:25.488 DEBUG:teuthology.orchestra.run:got remote process result: 6 2019-12-24T22:08:25.488 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2019-12-24T22:08:25.577 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:08:25.691 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:25.779 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:08:25.885 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:08:26.007 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:26.146 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:08:26.254 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:08:26.373 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:26.478 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:08:26.589 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:08:26.706 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:26.796 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:08:26.903 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:08:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:08:27.181 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:08:27.287 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:08:27.326 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rados' on pool 'unique_pool_4' 2019-12-24T22:08:27.404 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:27.489 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-24T22:08:27.503 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:08:27.610 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:08:27.729 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:27.829 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:08:27.937 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:08:27.993 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:08:27.993 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-24T22:08:28.052 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:28.137 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:08:28.243 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:08:28.331 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is unset 2019-12-24T22:08:28.357 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:28.445 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:08:28.552 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:08:28.659 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:29.155 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:08:29.182 INFO:teuthology.orchestra.run.smithi124:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.2 -b 65536 -O 65536 -p unique_pool_4 bench 90 write' 2019-12-24T22:08:29.186 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2019-12-24T22:08:29.186 INFO:teuthology.orchestra.run:waiting for 3000 2019-12-24T22:08:29.291 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:08:29.377 INFO:tasks.radosbench.radosbench.2.smithi124.stderr:unrecognized command -O; -h or --help for usage 2019-12-24T22:08:29.377 INFO:tasks.radosbench.radosbench.2.smithi124.stderr:error 22: (22) Invalid argument 2019-12-24T22:08:29.406 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:29.502 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:08:29.610 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:08:29.725 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:29.812 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:08:29.918 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:08:30.033 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:30.158 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:08:30.266 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:08:30.377 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:30.462 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:08:30.570 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:08:30.674 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:08:30.704 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:08:30.718 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:30.742 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:08:30.768 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:08:30.794 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:08:30.820 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:08:30.844 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:08:30.873 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:08:30.894 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:08:30.898 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:08:30.923 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:08:30.929 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:08:30.948 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:08:30.950 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-24T22:08:30.950 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-24T22:08:30.950 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-24T22:08:30.950 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-24T22:08:30.950 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-24T22:08:30.951 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-24T22:08:30.951 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-24T22:08:30.951 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-24T22:08:30.951 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-24T22:08:30.951 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.9 2019-12-24T22:08:30.951 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: problem getting command descriptions from osd.9 2019-12-24T22:08:30.951 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-24T22:08:30.952 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-24T22:08:31.036 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:08:31.146 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:31.212 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-24T22:08:31.237 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:08:31.344 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:08:31.473 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:31.625 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:08:31.625 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-24T22:08:31.705 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:08:31.810 DEBUG:teuthology.orchestra.run:got remote process result: 6 2019-12-24T22:08:31.810 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2019-12-24T22:08:31.885 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:08:32.006 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:32.094 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:08:32.201 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:08:32.316 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:32.410 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:08:32.518 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:08:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:32.719 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:08:32.825 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:08:32.940 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:33.028 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:08:33.136 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:08:33.303 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:33.541 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:08:33.666 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:08:33.792 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:33.811 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-24T22:08:33.880 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:08:33.986 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:08:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:08:34.054 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:34.221 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:08:34.334 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:08:34.362 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is unset 2019-12-24T22:08:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:34.552 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:08:34.659 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:08:34.702 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:08:34.703 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-24T22:08:34.798 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:35.096 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:08:35.219 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:08:35.288 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_4 2019-12-24T22:08:35.288 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool rm unique_pool_4 unique_pool_4 --yes-i-really-really-mean-it 2019-12-24T22:08:35.347 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:35.713 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:08:35.826 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:08:35.942 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:36.061 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:08:36.169 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:08:36.289 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:36.378 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:08:36.483 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:08:36.608 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:36.703 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:08:36.810 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:08:36.929 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:37.026 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:08:37.057 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:08:37.081 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:08:37.105 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:08:37.129 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:08:37.135 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:08:37.153 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:08:37.159 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd set noscrub 2019-12-24T22:08:37.184 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:08:37.209 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:08:37.233 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:08:37.247 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:37.263 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:08:37.287 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:08:37.313 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:08:37.316 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-24T22:08:37.316 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-24T22:08:37.316 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-24T22:08:37.316 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-24T22:08:37.317 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-24T22:08:37.317 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-24T22:08:37.317 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-24T22:08:37.317 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-24T22:08:37.317 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-24T22:08:37.317 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.9 2019-12-24T22:08:37.317 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: problem getting command descriptions from osd.9 2019-12-24T22:08:37.317 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-24T22:08:37.318 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-24T22:08:37.326 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:08:37.433 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:08:37.551 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:37.636 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:08:37.742 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:08:37.904 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:38.020 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:08:38.124 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:08:38.248 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:08:38.366 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:38.451 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:08:38.467 DEBUG:teuthology.orchestra.run:got remote process result: 6 2019-12-24T22:08:38.468 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2019-12-24T22:08:38.557 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:08:38.674 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:38.710 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:08:38.710 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-24T22:08:38.793 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:08:38.900 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:08:39.021 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:39.118 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:08:39.226 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:08:39.370 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:39.388 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_4' removed 2019-12-24T22:08:39.597 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:08:39.725 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:08:39.834 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:39.911 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:08:40.019 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:08:40.162 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2019-12-24T22:08:40.162 INFO:tasks.radosbench:Beginning radosbench... 2019-12-24T22:08:40.162 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_5 2019-12-24T22:08:40.163 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool create unique_pool_5 16 2019-12-24T22:08:40.167 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:40.404 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:08:40.469 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-24T22:08:40.510 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:08:40.614 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:41.170 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:08:41.381 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:08:41.398 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is set 2019-12-24T22:08:41.497 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:41.601 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:08:41.708 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:08:41.821 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:41.910 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:08:42.017 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:08:42.134 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:42.259 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:08:42.367 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:08:42.505 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:08:42.706 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:08:42.876 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:08:43.023 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:43.330 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:08:43.394 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:08:43.394 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-24T22:08:43.475 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:08:43.560 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:43.737 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:08:43.813 INFO:teuthology.orchestra.run.smithi037.stderr:2019-12-24T22:08:43.816+0000 7f67ad1ca700 0 --2- 172.21.15.37:0/526400408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67a8065e40 0x7f67a8066270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-24T22:08:43.842 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:08:43.959 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:43.967 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:08:44.014 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:08:44.049 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:08:44.060 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:08:44.078 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:08:44.103 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:08:44.127 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:08:44.152 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:08:44.167 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:08:44.177 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:08:44.204 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:08:44.250 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:44.335 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:08:44.360 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:08:44.361 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-24T22:08:44.362 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-24T22:08:44.362 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-24T22:08:44.362 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-24T22:08:44.362 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-24T22:08:44.362 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-24T22:08:44.362 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-24T22:08:44.363 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-24T22:08:44.363 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-24T22:08:44.363 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.9 2019-12-24T22:08:44.363 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: problem getting command descriptions from osd.9 2019-12-24T22:08:44.363 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-24T22:08:44.363 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-24T22:08:44.608 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-24T22:08:44.678 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:08:44.887 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:08:44.964 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:45.014 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_5' created 2019-12-24T22:08:45.112 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:08:45.234 DEBUG:teuthology.orchestra.run:got remote process result: 6 2019-12-24T22:08:45.234 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2019-12-24T22:08:45.299 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:08:45.447 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:45.908 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool application enable unique_pool_5 rados --yes-i-really-mean-it || true 2019-12-24T22:08:45.912 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:08:46.018 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:08:46.124 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:46.209 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:08:46.316 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:08:46.435 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:08:46.592 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:08:46.700 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:08:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:46.969 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:08:47.236 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-24T22:08:47.291 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:08:47.391 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:08:47.392 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-24T22:08:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:47.495 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:08:47.600 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:08:47.692 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:48.035 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is set 2019-12-24T22:08:48.505 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:08:48.710 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:08:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:49.319 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:08:49.504 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:08:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:50.018 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:08:50.196 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:08:50.309 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:50.408 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:08:50.516 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:08:50.559 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:08:50.582 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:08:50.604 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:08:50.627 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:08:50.634 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:50.653 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:08:50.678 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:08:50.703 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:08:50.727 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:08:50.734 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:08:50.751 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:08:50.778 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:08:50.802 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:08:50.803 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-24T22:08:50.804 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-24T22:08:50.804 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-24T22:08:50.804 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-24T22:08:50.804 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-24T22:08:50.804 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-24T22:08:50.804 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-24T22:08:50.804 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-24T22:08:50.805 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-24T22:08:50.805 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.9 2019-12-24T22:08:50.805 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: problem getting command descriptions from osd.9 2019-12-24T22:08:50.805 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-24T22:08:50.805 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-24T22:08:50.841 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:08:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:08:50.957 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:51.034 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:08:51.141 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:08:51.259 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:51.331 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rados' on pool 'unique_pool_5' 2019-12-24T22:08:51.400 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:08:51.508 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:08:51.573 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd unset noscrub 2019-12-24T22:08:51.582 DEBUG:teuthology.orchestra.run:got remote process result: 6 2019-12-24T22:08:51.582 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2019-12-24T22:08:51.621 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:51.708 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:08:51.815 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:08:51.895 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:08:51.895 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-24T22:08:51.935 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:52.026 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:08:52.133 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:08:52.254 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:52.349 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:08:52.456 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:08:52.565 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:52.667 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:08:52.775 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:08:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:53.066 INFO:teuthology.orchestra.run.smithi124:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.2 -b 65536 -O 65536 -p unique_pool_5 bench 90 write' 2019-12-24T22:08:53.069 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2019-12-24T22:08:53.069 INFO:teuthology.orchestra.run:waiting for 3000 2019-12-24T22:08:53.269 INFO:tasks.radosbench.radosbench.2.smithi124.stderr:unrecognized command -O; -h or --help for usage 2019-12-24T22:08:53.269 INFO:tasks.radosbench.radosbench.2.smithi124.stderr:error 22: (22) Invalid argument 2019-12-24T22:08:53.372 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:08:53.493 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:08:53.583 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-24T22:08:53.609 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:53.700 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:08:53.807 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:08:53.927 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:54.017 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:08:54.123 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:08:54.203 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:54.369 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is unset 2019-12-24T22:08:54.381 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:08:54.444 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:08:54.553 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:08:54.670 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:54.778 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:08:54.883 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:08:55.024 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:55.302 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:08:55.452 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:08:55.524 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:08:55.525 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-24T22:08:55.569 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:55.667 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:08:55.773 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:08:55.860 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:56.035 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:08:56.215 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:08:56.333 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:56.376 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:08:56.399 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:08:56.420 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:08:56.433 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:08:56.443 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:08:56.469 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:08:56.500 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:08:56.525 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:08:56.541 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:08:56.550 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:08:56.576 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:08:56.601 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:08:56.626 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:08:56.629 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-24T22:08:56.629 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-24T22:08:56.629 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-24T22:08:56.629 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-24T22:08:56.629 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-24T22:08:56.629 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-24T22:08:56.630 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-24T22:08:56.630 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-24T22:08:56.630 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-24T22:08:56.630 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.9 2019-12-24T22:08:56.630 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: problem getting command descriptions from osd.9 2019-12-24T22:08:56.630 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-24T22:08:56.630 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-24T22:08:56.631 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:56.967 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:08:57.140 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-24T22:08:57.171 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:08:57.275 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:57.449 DEBUG:teuthology.orchestra.run:got remote process result: 6 2019-12-24T22:08:57.450 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2019-12-24T22:08:57.480 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:08:57.665 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:08:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:57.882 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:08:57.990 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:08:58.106 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:08:58.207 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:08:58.315 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:08:58.436 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:58.713 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:08:58.854 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:08:59.002 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:59.172 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_5 2019-12-24T22:08:59.172 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool rm unique_pool_5 unique_pool_5 --yes-i-really-really-mean-it 2019-12-24T22:08:59.209 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:08:59.276 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:08:59.276 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-24T22:08:59.365 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:08:59.451 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-24T22:08:59.480 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:59.566 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:08:59.674 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:08:59.747 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:08:59.901 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:09:00.019 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:09:00.127 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:00.240 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:09:00.339 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is unset 2019-12-24T22:09:00.349 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:09:00.463 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:00.558 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:09:00.665 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:09:00.784 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:00.866 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:09:00.972 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:09:01.091 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:01.198 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:09:01.307 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:09:01.479 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:01.843 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:09:02.034 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:09:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:02.298 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:09:02.407 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:09:02.503 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:02.571 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:09:02.635 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:09:02.739 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:09:02.851 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:02.949 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:09:03.056 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:09:03.164 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:09:03.195 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:03.198 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:09:03.198 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-24T22:09:03.211 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:09:03.234 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:09:03.260 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:09:03.267 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:09:03.286 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:09:03.311 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:09:03.335 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:09:03.349 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_5' removed 2019-12-24T22:09:03.372 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:09:03.375 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:09:03.401 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:09:03.426 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:09:03.451 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:03.568 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:09:03.673 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:09:03.681 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:09:03.684 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-24T22:09:03.684 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-24T22:09:03.684 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-24T22:09:03.684 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-24T22:09:03.684 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-24T22:09:03.684 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-24T22:09:03.685 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-24T22:09:03.685 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-24T22:09:03.685 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-24T22:09:03.685 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.9 2019-12-24T22:09:03.685 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: problem getting command descriptions from osd.9 2019-12-24T22:09:03.685 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-24T22:09:03.685 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-24T22:09:03.791 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:03.882 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:09:03.988 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:09:04.078 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd set noscrub 2019-12-24T22:09:04.106 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:04.140 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2019-12-24T22:09:04.140 INFO:tasks.radosbench:Beginning radosbench... 2019-12-24T22:09:04.140 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_6 2019-12-24T22:09:04.141 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool create unique_pool_6 16 2019-12-24T22:09:04.238 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:09:04.345 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:09:04.417 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:04.594 DEBUG:teuthology.orchestra.run:got remote process result: 6 2019-12-24T22:09:04.594 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2019-12-24T22:09:04.746 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:09:04.899 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:09:05.037 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:05.526 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:09:05.632 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:09:05.748 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:05.865 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:09:05.972 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:09:06.090 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:06.189 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:09:06.296 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:09:06.396 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:06.595 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-24T22:09:06.734 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:09:07.134 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:09:07.425 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:09:07.572 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:09:07.572 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-24T22:09:07.579 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:07.761 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:09:07.877 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:09:07.995 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:08.089 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:09:08.096 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_6' created 2019-12-24T22:09:08.196 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:09:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:08.525 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:09:08.636 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:09:08.751 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:08.848 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:09:08.956 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:09:09.076 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:09.110 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is set 2019-12-24T22:09:09.164 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:09:09.270 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:09:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:09.444 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool application enable unique_pool_6 rados --yes-i-really-mean-it || true 2019-12-24T22:09:09.491 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:09:09.784 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:09:09.902 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:09.997 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:09:10.103 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:09:10.224 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:10.273 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:09:10.294 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:09:10.317 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:09:10.340 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:09:10.365 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:09:10.390 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:09:10.415 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:09:10.440 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:09:10.464 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:09:10.498 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:09:10.521 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:09:10.524 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-24T22:09:10.524 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-24T22:09:10.524 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-24T22:09:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-24T22:09:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-24T22:09:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-24T22:09:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-24T22:09:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-24T22:09:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-24T22:09:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.9 2019-12-24T22:09:10.526 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: problem getting command descriptions from osd.9 2019-12-24T22:09:10.526 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-24T22:09:10.526 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-24T22:09:10.616 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:09:10.740 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:09:10.858 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:11.300 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:09:11.352 DEBUG:teuthology.orchestra.run:got remote process result: 6 2019-12-24T22:09:11.353 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2019-12-24T22:09:11.383 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:09:11.493 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:09:11.613 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:11.748 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:09:11.856 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:09:12.026 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:12.073 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:09:12.073 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-24T22:09:12.283 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:09:12.390 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:09:12.490 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:12.652 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-24T22:09:12.825 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:09:12.930 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:09:13.001 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:13.090 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:09:13.179 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rados' on pool 'unique_pool_6' 2019-12-24T22:09:13.214 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:09:13.331 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:13.354 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-24T22:09:13.422 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:09:13.529 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:09:13.642 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:13.723 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:09:13.829 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:09:13.949 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:14.063 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:09:14.170 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:09:14.285 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:14.373 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:09:14.478 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:09:14.602 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:14.697 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:09:14.804 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:09:14.919 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:15.022 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:09:15.130 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:09:15.159 INFO:teuthology.orchestra.run.smithi124:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.2 -b 65536 -O 65536 -p unique_pool_6 bench 90 write' 2019-12-24T22:09:15.162 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2019-12-24T22:09:15.163 INFO:teuthology.orchestra.run:waiting for 3000 2019-12-24T22:09:15.245 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:15.346 INFO:tasks.radosbench.radosbench.2.smithi124.stderr:unrecognized command -O; -h or --help for usage 2019-12-24T22:09:15.346 INFO:tasks.radosbench.radosbench.2.smithi124.stderr:error 22: (22) Invalid argument 2019-12-24T22:09:15.347 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:09:15.453 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:09:15.570 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:09:15.571 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:15.672 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:09:15.779 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:09:15.895 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:16.034 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:09:16.094 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:09:16.094 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-24T22:09:16.141 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:09:16.259 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:16.372 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:09:16.480 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:09:16.576 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:16.719 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:09:16.741 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:09:16.763 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:09:16.785 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:09:16.809 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:09:16.816 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:09:16.834 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:09:16.859 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:09:16.894 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:09:16.919 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:09:16.922 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:09:16.963 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:09:16.988 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:09:16.989 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-24T22:09:16.989 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-24T22:09:16.989 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-24T22:09:16.990 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-24T22:09:16.990 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-24T22:09:16.990 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-24T22:09:16.990 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-24T22:09:16.990 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-24T22:09:16.990 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-24T22:09:16.990 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.9 2019-12-24T22:09:16.991 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: problem getting command descriptions from osd.9 2019-12-24T22:09:16.991 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-24T22:09:16.991 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-24T22:09:17.006 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:17.239 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:09:17.350 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:09:17.355 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is set 2019-12-24T22:09:17.460 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:17.571 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:09:17.679 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:09:17.795 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:17.880 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:09:17.988 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:09:18.011 DEBUG:teuthology.orchestra.run:got remote process result: 6 2019-12-24T22:09:18.012 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2019-12-24T22:09:18.102 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:18.217 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:09:18.324 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:09:18.480 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:18.673 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:09:18.707 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:09:18.783 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:09:18.888 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:19.115 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:09:19.243 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:09:19.347 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:09:19.348 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-24T22:09:19.359 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:19.454 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:09:19.562 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:09:19.677 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:19.804 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:09:19.913 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:09:20.013 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-24T22:09:20.025 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:20.139 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:09:20.247 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:09:20.265 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd unset noscrub 2019-12-24T22:09:20.317 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:20.628 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:09:20.742 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:09:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:21.049 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:09:21.156 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:09:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:21.264 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_6 2019-12-24T22:09:21.265 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool rm unique_pool_6 unique_pool_6 --yes-i-really-really-mean-it 2019-12-24T22:09:21.369 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:09:21.474 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:09:21.550 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:22.157 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:09:22.265 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:09:22.442 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:09:22.560 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:22.646 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:09:22.752 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:09:22.869 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:22.993 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:09:22.993 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-24T22:09:22.995 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:09:23.104 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:09:23.181 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:23.424 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:09:23.640 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:09:23.645 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:09:23.669 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:09:23.695 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:09:23.723 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:09:23.748 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:09:23.760 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:23.773 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:09:23.803 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:09:23.827 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:09:23.850 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:09:23.854 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:09:23.876 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:09:23.904 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:09:23.905 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-24T22:09:23.906 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-24T22:09:23.906 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-24T22:09:23.906 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-24T22:09:23.906 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-24T22:09:23.906 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-24T22:09:23.906 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-24T22:09:23.906 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-24T22:09:23.907 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-24T22:09:23.907 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.9 2019-12-24T22:09:23.907 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: problem getting command descriptions from osd.9 2019-12-24T22:09:23.907 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-24T22:09:23.907 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-24T22:09:23.961 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:09:24.053 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:24.299 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:09:24.337 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is unset 2019-12-24T22:09:24.405 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:09:24.526 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:24.620 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:09:24.727 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:09:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:24.944 DEBUG:teuthology.orchestra.run:got remote process result: 6 2019-12-24T22:09:24.945 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2019-12-24T22:09:25.148 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:09:25.296 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:09:25.430 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:25.726 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:09:25.881 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:09:25.998 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:26.087 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:09:26.166 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2019-12-24T22:09:26.167 INFO:teuthology.orchestra.run.smithi037.stdout: "ops": [], 2019-12-24T22:09:26.167 INFO:teuthology.orchestra.run.smithi037.stdout: "num_ops": 0 2019-12-24T22:09:26.167 INFO:teuthology.orchestra.run.smithi037.stdout:} 2019-12-24T22:09:26.193 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:09:26.333 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:26.623 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:09:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_6' removed 2019-12-24T22:09:26.744 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-24T22:09:26.828 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:09:26.919 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:26.946 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-24T22:09:27.139 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:09:27.250 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2019-12-24T22:09:27.250 INFO:tasks.radosbench:Beginning radosbench... 2019-12-24T22:09:27.251 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_7 2019-12-24T22:09:27.251 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool create unique_pool_7 16 2019-12-24T22:09:27.318 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:09:27.436 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:27.537 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:09:27.645 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:09:27.766 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:27.793 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-24T22:09:27.853 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:09:27.960 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.8 2019-12-24T22:09:28.078 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:28.179 INFO:teuthology.orchestra.run.smithi124.stdout:51e72b27dbcf92520c060a5c0b0cfb3932fd7895f5e90de28af52e836cdfbe52 2019-12-24T22:09:28.287 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:09:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:28.698 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:09:28.819 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:09:28.940 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:29.020 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:09:29.128 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:09:29.280 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:29.759 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:09:29.815 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2019-12-24T22:09:29.815 INFO:teuthology.orchestra.run.smithi037.stdout: "ops": [], 2019-12-24T22:09:29.815 INFO:teuthology.orchestra.run.smithi037.stdout: "complaint_time": 30, 2019-12-24T22:09:29.815 INFO:teuthology.orchestra.run.smithi037.stdout: "num_blocked_ops": 0 2019-12-24T22:09:29.815 INFO:teuthology.orchestra.run.smithi037.stdout:} 2019-12-24T22:09:29.862 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:09:30.013 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:30.288 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:09:30.410 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:09:30.529 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:30.628 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:09:30.715 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-24T22:09:30.736 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:09:30.855 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:30.929 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:09:31.035 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:09:31.130 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:31.431 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:09:31.453 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:09:31.471 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:09:31.476 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:09:31.496 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:09:31.521 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:09:31.547 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:09:31.571 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:09:31.577 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:09:31.599 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:09:31.633 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:09:31.662 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:31.730 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:09:31.834 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:09:31.842 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:09:31.868 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:09:31.869 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-24T22:09:31.869 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-24T22:09:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-24T22:09:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-24T22:09:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-24T22:09:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-24T22:09:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-24T22:09:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-24T22:09:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-24T22:09:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.9 2019-12-24T22:09:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: problem getting command descriptions from osd.9 2019-12-24T22:09:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-24T22:09:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-24T22:09:31.927 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:31.988 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:09:32.093 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:09:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:32.498 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_7' created 2019-12-24T22:09:32.498 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is unset 2019-12-24T22:09:32.647 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:09:32.764 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:09:32.887 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:33.130 DEBUG:teuthology.orchestra.run:got remote process result: 6 2019-12-24T22:09:33.130 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2019-12-24T22:09:33.221 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:09:33.421 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:09:33.539 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:33.621 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:09:33.729 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:09:33.748 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool application enable unique_pool_7 rados --yes-i-really-mean-it || true 2019-12-24T22:09:33.843 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:33.945 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:09:34.028 INFO:teuthology.orchestra.run.smithi037.stdout:ERROR: (22) Invalid argument 2019-12-24T22:09:34.053 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:09:34.132 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:34.271 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:09:34.379 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:09:34.500 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:34.602 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:09:34.710 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:09:34.822 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-24T22:09:34.826 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:34.936 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:09:35.043 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:09:35.117 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:35.131 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-24T22:09:35.230 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:09:35.334 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:09:35.378 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd set noscrub 2019-12-24T22:09:35.455 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:35.544 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:09:35.651 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:09:35.739 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:35.905 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:09:36.010 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:09:36.127 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:36.220 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:09:36.327 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:09:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:37.093 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:09:37.278 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:09:37.396 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:37.494 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:09:37.539 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rados' on pool 'unique_pool_7' 2019-12-24T22:09:37.600 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:09:37.719 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:37.819 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:09:37.926 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:09:38.046 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:38.152 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:09:38.260 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:09:38.377 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:38.458 INFO:teuthology.orchestra.run.smithi037.stdout:ERROR: (22) Invalid argument 2019-12-24T22:09:38.469 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:09:38.576 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:09:38.714 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:39.175 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-24T22:09:39.204 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:09:39.243 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:09:39.266 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:09:39.288 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:09:39.309 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:09:39.310 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:09:39.336 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:09:39.373 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:09:39.420 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:39.510 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:09:39.617 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:09:39.623 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:09:39.652 INFO:teuthology.orchestra.run.smithi124:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.2 -b 65536 -O 65536 -p unique_pool_7 bench 90 write' 2019-12-24T22:09:39.655 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2019-12-24T22:09:39.655 INFO:teuthology.orchestra.run:waiting for 3000 2019-12-24T22:09:39.661 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:09:39.695 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:09:39.728 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:39.728 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:09:39.755 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:09:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-24T22:09:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-24T22:09:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-24T22:09:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-24T22:09:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-24T22:09:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-24T22:09:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-24T22:09:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-24T22:09:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-24T22:09:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.9 2019-12-24T22:09:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: problem getting command descriptions from osd.9 2019-12-24T22:09:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-24T22:09:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-24T22:09:39.806 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:09:39.863 INFO:tasks.radosbench.radosbench.2.smithi124.stderr:unrecognized command -O; -h or --help for usage 2019-12-24T22:09:39.863 INFO:tasks.radosbench.radosbench.2.smithi124.stderr:error 22: (22) Invalid argument 2019-12-24T22:09:39.910 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.2 2019-12-24T22:09:40.024 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:40.335 DEBUG:teuthology.orchestra.run:got remote process result: 6 2019-12-24T22:09:40.336 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2019-12-24T22:09:40.353 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is set 2019-12-24T22:09:40.522 INFO:teuthology.orchestra.run.smithi037.stdout:e6e8f49d1a4cbee871090dd2279ca70d105b516f49087b4314fe65a7dead58c9 2019-12-24T22:09:40.633 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:09:40.749 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:40.844 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:09:40.951 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.11 2019-12-24T22:09:41.066 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:41.160 INFO:teuthology.orchestra.run.smithi124.stdout:7760212c2e869246c7704cb47211a94ae76bcab8d8390e407edab380ae7f2623 2019-12-24T22:09:41.268 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:09:41.387 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:41.485 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:09:41.592 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:09:41.698 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2019-12-24T22:09:41.698 INFO:teuthology.orchestra.run.smithi037.stdout: "ops": [], 2019-12-24T22:09:41.698 INFO:teuthology.orchestra.run.smithi037.stdout: "complaint_time": 30, 2019-12-24T22:09:41.698 INFO:teuthology.orchestra.run.smithi037.stdout: "num_blocked_ops": 0 2019-12-24T22:09:41.699 INFO:teuthology.orchestra.run.smithi037.stdout:} 2019-12-24T22:09:41.730 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:41.829 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:09:41.936 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:09:42.065 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:42.246 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:09:42.336 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-24T22:09:42.371 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-24T22:09:42.447 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:09:42.558 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:42.651 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:09:42.759 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:09:42.879 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:42.976 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:09:43.085 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.7 2019-12-24T22:09:43.200 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:43.215 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-24T22:09:43.336 INFO:teuthology.orchestra.run.smithi006.stdout:668d8ee88ea20259114bad822c0b50da527b6f33ffbd55b59e32a865204827f8 2019-12-24T22:09:43.444 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:09:43.547 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:43.813 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:09:43.919 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:09:44.041 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:44.143 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:09:44.251 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:09:44.367 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:44.460 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:09:44.567 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:09:44.683 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:44.776 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:09:44.884 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:09:45.002 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:45.036 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2019-12-24T22:09:45.036 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 20, 2019-12-24T22:09:45.036 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 600, 2019-12-24T22:09:45.037 INFO:teuthology.orchestra.run.smithi037.stdout: "ops": [ 2019-12-24T22:09:45.037 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.037 INFO:teuthology.orchestra.run.smithi037.stdout: "description": "MOSDScrubReserve(1.1 REQUEST e91)", 2019-12-24T22:09:45.037 INFO:teuthology.orchestra.run.smithi037.stdout: "initiated_at": "2019-12-24T22:07:05.831718+0000", 2019-12-24T22:09:45.037 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 159.21198702699999, 2019-12-24T22:09:45.037 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0.00036202499999999998, 2019-12-24T22:09:45.037 INFO:teuthology.orchestra.run.smithi037.stdout: "type_data": { 2019-12-24T22:09:45.038 INFO:teuthology.orchestra.run.smithi037.stdout: "flag_point": "started", 2019-12-24T22:09:45.038 INFO:teuthology.orchestra.run.smithi037.stdout: "events": [ 2019-12-24T22:09:45.038 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.038 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "initiated", 2019-12-24T22:09:45.038 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.831718+0000", 2019-12-24T22:09:45.038 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0 2019-12-24T22:09:45.038 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.038 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.039 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "throttled", 2019-12-24T22:09:45.039 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.831718+0000", 2019-12-24T22:09:45.039 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 8.2279999999999998e-06 2019-12-24T22:09:45.039 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.039 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.039 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "header_read", 2019-12-24T22:09:45.039 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.831726+0000", 2019-12-24T22:09:45.040 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 7.8660000000000006e-06 2019-12-24T22:09:45.040 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.040 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.040 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "all_read", 2019-12-24T22:09:45.040 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.831734+0000", 2019-12-24T22:09:45.040 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 3.3003000000000002e-05 2019-12-24T22:09:45.040 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.041 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.041 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "dispatched", 2019-12-24T22:09:45.041 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.831767+0000", 2019-12-24T22:09:45.041 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 2.4987999999999999e-05 2019-12-24T22:09:45.041 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.041 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.041 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "queued_for_pg", 2019-12-24T22:09:45.041 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.831792+0000", 2019-12-24T22:09:45.042 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0.000143592 2019-12-24T22:09:45.042 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.042 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.042 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "reached_pg", 2019-12-24T22:09:45.042 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.831936+0000", 2019-12-24T22:09:45.042 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 6.9857000000000006e-05 2019-12-24T22:09:45.042 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.043 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.043 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "started", 2019-12-24T22:09:45.043 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.832006+0000", 2019-12-24T22:09:45.043 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 7.4491000000000002e-05 2019-12-24T22:09:45.043 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.043 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.043 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "done", 2019-12-24T22:09:45.043 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.832080+0000", 2019-12-24T22:09:45.044 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0.00036202499999999998 2019-12-24T22:09:45.044 INFO:teuthology.orchestra.run.smithi037.stdout: } 2019-12-24T22:09:45.044 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2019-12-24T22:09:45.044 INFO:teuthology.orchestra.run.smithi037.stdout: } 2019-12-24T22:09:45.044 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.045 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.045 INFO:teuthology.orchestra.run.smithi037.stdout: "description": "replica_scrub(pg: 1.1,from:0'0,to:0'0,epoch:91/89,start:1:80000000::::0,end:MAX,chunky:1,deep:0,version:9,allow_preemption:1,priority=5)", 2019-12-24T22:09:45.045 INFO:teuthology.orchestra.run.smithi037.stdout: "initiated_at": "2019-12-24T22:07:05.832905+0000", 2019-12-24T22:09:45.045 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 159.21079996200001, 2019-12-24T22:09:45.045 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0.00035176899999999999, 2019-12-24T22:09:45.045 INFO:teuthology.orchestra.run.smithi037.stdout: "type_data": { 2019-12-24T22:09:45.045 INFO:teuthology.orchestra.run.smithi037.stdout: "flag_point": "reached pg", 2019-12-24T22:09:45.046 INFO:teuthology.orchestra.run.smithi037.stdout: "events": [ 2019-12-24T22:09:45.046 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.046 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "initiated", 2019-12-24T22:09:45.046 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.832905+0000", 2019-12-24T22:09:45.046 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0 2019-12-24T22:09:45.046 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.046 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.047 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "throttled", 2019-12-24T22:09:45.047 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.832905+0000", 2019-12-24T22:09:45.047 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 1.0165e-05 2019-12-24T22:09:45.047 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.047 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.047 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "header_read", 2019-12-24T22:09:45.048 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.832915+0000", 2019-12-24T22:09:45.048 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 9.8949999999999993e-06 2019-12-24T22:09:45.048 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.048 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.048 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "all_read", 2019-12-24T22:09:45.048 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.832925+0000", 2019-12-24T22:09:45.048 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 3.2897e-05 2019-12-24T22:09:45.049 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.049 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.049 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "dispatched", 2019-12-24T22:09:45.049 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.832958+0000", 2019-12-24T22:09:45.049 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 1.2136999999999999e-05 2019-12-24T22:09:45.049 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.049 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.050 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "queued_for_pg", 2019-12-24T22:09:45.050 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.832970+0000", 2019-12-24T22:09:45.050 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0.00018200200000000001 2019-12-24T22:09:45.050 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.051 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.051 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "reached_pg", 2019-12-24T22:09:45.051 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.833152+0000", 2019-12-24T22:09:45.051 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0.00010467300000000001 2019-12-24T22:09:45.051 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.051 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.051 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "done", 2019-12-24T22:09:45.052 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.833257+0000", 2019-12-24T22:09:45.052 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0.00035176899999999999 2019-12-24T22:09:45.052 INFO:teuthology.orchestra.run.smithi037.stdout: } 2019-12-24T22:09:45.052 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2019-12-24T22:09:45.052 INFO:teuthology.orchestra.run.smithi037.stdout: } 2019-12-24T22:09:45.052 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.052 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.053 INFO:teuthology.orchestra.run.smithi037.stdout: "description": "MOSDScrubReserve(1.1 RELEASE e91)", 2019-12-24T22:09:45.053 INFO:teuthology.orchestra.run.smithi037.stdout: "initiated_at": "2019-12-24T22:07:05.834502+0000", 2019-12-24T22:09:45.053 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 159.20920264099999, 2019-12-24T22:09:45.053 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0.000188875, 2019-12-24T22:09:45.053 INFO:teuthology.orchestra.run.smithi037.stdout: "type_data": { 2019-12-24T22:09:45.053 INFO:teuthology.orchestra.run.smithi037.stdout: "flag_point": "started", 2019-12-24T22:09:45.053 INFO:teuthology.orchestra.run.smithi037.stdout: "events": [ 2019-12-24T22:09:45.054 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.054 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "initiated", 2019-12-24T22:09:45.054 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.834502+0000", 2019-12-24T22:09:45.054 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0 2019-12-24T22:09:45.055 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.055 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.055 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "throttled", 2019-12-24T22:09:45.055 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.834502+0000", 2019-12-24T22:09:45.055 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 4.5889999999999996e-06 2019-12-24T22:09:45.056 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.056 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.056 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "header_read", 2019-12-24T22:09:45.056 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.834507+0000", 2019-12-24T22:09:45.056 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 5.3770000000000004e-06 2019-12-24T22:09:45.056 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.056 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.057 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "all_read", 2019-12-24T22:09:45.057 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.834512+0000", 2019-12-24T22:09:45.057 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 3.6557000000000003e-05 2019-12-24T22:09:45.057 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.057 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.057 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "dispatched", 2019-12-24T22:09:45.057 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.834549+0000", 2019-12-24T22:09:45.057 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 1.4755e-05 2019-12-24T22:09:45.058 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.058 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.058 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "queued_for_pg", 2019-12-24T22:09:45.058 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.834564+0000", 2019-12-24T22:09:45.058 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 8.5496999999999998e-05 2019-12-24T22:09:45.058 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.058 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.059 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "reached_pg", 2019-12-24T22:09:45.059 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.834649+0000", 2019-12-24T22:09:45.059 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 3.3642000000000001e-05 2019-12-24T22:09:45.059 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.059 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.059 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "started", 2019-12-24T22:09:45.059 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.834683+0000", 2019-12-24T22:09:45.060 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 8.4579999999999993e-06 2019-12-24T22:09:45.060 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:45.060 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:45.060 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "done", 2019-12-24T22:09:45.060 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:05.834691+0000", 2019-12-24T22:09:45.060 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0.000188875 2019-12-24T22:09:45.061 INFO:teuthology.orchestra.run.smithi037.stdout: } 2019-12-24T22:09:45.061 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2019-12-24T22:09:45.061 INFO:teuthology.orchestra.run.smithi037.stdout: } 2019-12-24T22:09:45.061 INFO:teuthology.orchestra.run.smithi037.stdout: } 2019-12-24T22:09:45.061 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2019-12-24T22:09:45.061 INFO:teuthology.orchestra.run.smithi037.stdout:} 2019-12-24T22:09:45.093 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:09:45.201 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.5 2019-12-24T22:09:45.323 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:45.426 INFO:teuthology.orchestra.run.smithi006.stdout:3878bb598769ac08a93a15166d64b78714e6041933036ebb91ca8590e15f17c4 2019-12-24T22:09:45.533 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.0 2019-12-24T22:09:45.696 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:45.757 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_7 2019-12-24T22:09:45.757 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd pool rm unique_pool_7 unique_pool_7 --yes-i-really-really-mean-it 2019-12-24T22:09:45.845 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-24T22:09:45.870 INFO:teuthology.orchestra.run.smithi037.stdout:af10cb6e16b192057e662e5d00c116df50bc048f13a4d456ca579db11528181e 2019-12-24T22:09:45.936 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:09:45.956 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:09:45.976 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:09:45.980 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:09:46.004 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:09:46.029 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:09:46.054 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:09:46.078 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:09:46.086 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:46.104 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:09:46.130 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:09:46.152 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:09:46.168 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:09:46.175 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:09:46.177 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-24T22:09:46.177 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-24T22:09:46.177 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-24T22:09:46.177 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-24T22:09:46.177 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-24T22:09:46.178 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-24T22:09:46.178 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-24T22:09:46.178 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-24T22:09:46.178 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-24T22:09:46.178 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.9 2019-12-24T22:09:46.178 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: problem getting command descriptions from osd.9 2019-12-24T22:09:46.178 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-24T22:09:46.179 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-24T22:09:46.274 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:09:46.355 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:46.889 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:09:47.080 DEBUG:teuthology.orchestra.run:got remote process result: 6 2019-12-24T22:09:47.081 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2019-12-24T22:09:47.127 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:09:47.232 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is set 2019-12-24T22:09:47.662 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:09:47.775 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.6 2019-12-24T22:09:47.896 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:47.992 INFO:teuthology.orchestra.run.smithi006.stdout:8e9cac815a4647e80b698b1c42c63b8388e9f679f986998c122f80519b2d939f 2019-12-24T22:09:48.099 INFO:teuthology.orchestra.run.smithi124:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.10 2019-12-24T22:09:48.215 INFO:teuthology.orchestra.run.smithi124.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:48.301 INFO:teuthology.orchestra.run.smithi124.stdout:f1f27fc740f58acf9ac9c5b7a42c84e1341ad701bf942e3a6d801ed90b27219e 2019-12-24T22:09:48.408 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:09:48.539 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:48.695 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:09:48.875 INFO:teuthology.orchestra.run.smithi006:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.4 2019-12-24T22:09:48.995 INFO:teuthology.orchestra.run.smithi006.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:49.082 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-24T22:09:49.092 INFO:teuthology.orchestra.run.smithi006.stdout:8a595f2a135ae18034ba3418204852f8039039ac4b37b92261f634374924e785 2019-12-24T22:09:49.200 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.1 2019-12-24T22:09:49.249 INFO:teuthology.orchestra.run.smithi037.stdout:ERROR: (22) Invalid argument 2019-12-24T22:09:49.282 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:49.346 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_7' removed 2019-12-24T22:09:49.749 INFO:teuthology.orchestra.run.smithi037.stdout:808e7662986602bd4dd6470ab0fb456ff4e73eae6bfa73f7b4d983c75e51dd28 2019-12-24T22:09:49.891 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-24T22:09:49.953 INFO:teuthology.orchestra.run.smithi037:> sudo docker kill -s 1 ceph-4a02c23c-2698-11ea-8286-001a4aab830c-osd.3 2019-12-24T22:09:50.056 INFO:teuthology.orchestra.run.smithi037.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2019-12-24T22:09:50.479 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2019-12-24T22:09:50.563 INFO:tasks.thrashosds:joining thrashosds 2019-12-24T22:09:50.564 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2019-12-24T22:09:50.565 INFO:teuthology.orchestra.run.smithi037.stdout:045a4a1a0d31c01204e26d597bfcbb8dc22741b77d343c77e5bbb66168a27101 2019-12-24T22:09:50.569 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd unset noscrub 2019-12-24T22:09:50.666 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2019-12-24T22:09:52.776 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0: {} 2019-12-24T22:09:52.802 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1: {} 2019-12-24T22:09:52.823 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2: {} 2019-12-24T22:09:52.845 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3: {} 2019-12-24T22:09:52.870 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4: {} 2019-12-24T22:09:52.898 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5: {} 2019-12-24T22:09:52.923 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6: {} 2019-12-24T22:09:52.957 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7: {} 2019-12-24T22:09:52.987 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8: {} 2019-12-24T22:09:53.014 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10: {} 2019-12-24T22:09:53.038 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11: {} 2019-12-24T22:09:53.040 INFO:teuthology.orchestra.run.smithi037.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-24T22:09:53.040 INFO:teuthology.orchestra.run.smithi037.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-24T22:09:53.040 INFO:teuthology.orchestra.run.smithi037.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-24T22:09:53.040 INFO:teuthology.orchestra.run.smithi037.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-24T22:09:53.040 INFO:teuthology.orchestra.run.smithi037.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-24T22:09:53.040 INFO:teuthology.orchestra.run.smithi037.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-24T22:09:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-24T22:09:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-24T22:09:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-24T22:09:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENXIO: problem getting command descriptions from osd.9 2019-12-24T22:09:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:osd.9: problem getting command descriptions from osd.9 2019-12-24T22:09:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-24T22:09:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-24T22:09:53.241 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2019-12-24T22:09:53.241 INFO:teuthology.orchestra.run.smithi037.stdout: "ops": [], 2019-12-24T22:09:53.241 INFO:teuthology.orchestra.run.smithi037.stdout: "complaint_time": 30, 2019-12-24T22:09:53.241 INFO:teuthology.orchestra.run.smithi037.stdout: "num_blocked_ops": 0 2019-12-24T22:09:53.241 INFO:teuthology.orchestra.run.smithi037.stdout:} 2019-12-24T22:09:54.043 DEBUG:teuthology.orchestra.run:got remote process result: 6 2019-12-24T22:09:54.044 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2019-12-24T22:09:54.044 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-24T22:09:54.199 INFO:teuthology.orchestra.run.smithi037.stderr:noscrub is unset 2019-12-24T22:09:54.672 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-24T22:09:56.045 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2019-12-24T22:09:56.863 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2019-12-24T22:09:56.863 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 20, 2019-12-24T22:09:56.863 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 600, 2019-12-24T22:09:56.863 INFO:teuthology.orchestra.run.smithi037.stdout: "ops": [ 2019-12-24T22:09:56.864 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.864 INFO:teuthology.orchestra.run.smithi037.stdout: "description": "MOSDScrubReserve(1.7 REQUEST e91)", 2019-12-24T22:09:56.864 INFO:teuthology.orchestra.run.smithi037.stdout: "initiated_at": "2019-12-24T22:07:04.739157+0000", 2019-12-24T22:09:56.864 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 172.13107280700001, 2019-12-24T22:09:56.864 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0.00015656599999999999, 2019-12-24T22:09:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: "type_data": { 2019-12-24T22:09:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: "flag_point": "started", 2019-12-24T22:09:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: "events": [ 2019-12-24T22:09:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "initiated", 2019-12-24T22:09:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.739157+0000", 2019-12-24T22:09:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0 2019-12-24T22:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "throttled", 2019-12-24T22:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.739157+0000", 2019-12-24T22:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 4.0110000000000002e-06 2019-12-24T22:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "header_read", 2019-12-24T22:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.739161+0000", 2019-12-24T22:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 2.481e-06 2019-12-24T22:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "all_read", 2019-12-24T22:09:56.868 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.739164+0000", 2019-12-24T22:09:56.868 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 4.8819999999999997e-05 2019-12-24T22:09:56.868 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.868 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.868 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "dispatched", 2019-12-24T22:09:56.868 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.739212+0000", 2019-12-24T22:09:56.869 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 7.9249999999999995e-06 2019-12-24T22:09:56.869 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.869 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.869 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "queued_for_pg", 2019-12-24T22:09:56.869 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.739220+0000", 2019-12-24T22:09:56.869 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 6.3423000000000006e-05 2019-12-24T22:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "reached_pg", 2019-12-24T22:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.739284+0000", 2019-12-24T22:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 1.1754e-05 2019-12-24T22:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "started", 2019-12-24T22:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.739296+0000", 2019-12-24T22:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 1.8151999999999998e-05 2019-12-24T22:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "done", 2019-12-24T22:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.739314+0000", 2019-12-24T22:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0.00015656599999999999 2019-12-24T22:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: } 2019-12-24T22:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2019-12-24T22:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: } 2019-12-24T22:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: "description": "replica_scrub(pg: 1.7,from:0'0,to:0'0,epoch:91/89,start:1:e0000000::::0,end:MAX,chunky:1,deep:0,version:9,allow_preemption:1,priority=5)", 2019-12-24T22:09:56.873 INFO:teuthology.orchestra.run.smithi037.stdout: "initiated_at": "2019-12-24T22:07:04.740295+0000", 2019-12-24T22:09:56.873 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 172.12993496499999, 2019-12-24T22:09:56.873 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0.00015851099999999999, 2019-12-24T22:09:56.873 INFO:teuthology.orchestra.run.smithi037.stdout: "type_data": { 2019-12-24T22:09:56.873 INFO:teuthology.orchestra.run.smithi037.stdout: "flag_point": "reached pg", 2019-12-24T22:09:56.873 INFO:teuthology.orchestra.run.smithi037.stdout: "events": [ 2019-12-24T22:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "initiated", 2019-12-24T22:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.740295+0000", 2019-12-24T22:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0 2019-12-24T22:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "throttled", 2019-12-24T22:09:56.875 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.740295+0000", 2019-12-24T22:09:56.875 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 2.1380000000000001e-06 2019-12-24T22:09:56.875 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.875 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.875 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "header_read", 2019-12-24T22:09:56.875 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.740297+0000", 2019-12-24T22:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 6.1240000000000002e-06 2019-12-24T22:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "all_read", 2019-12-24T22:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.740303+0000", 2019-12-24T22:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 1.2653999999999999e-05 2019-12-24T22:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.877 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.877 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "dispatched", 2019-12-24T22:09:56.877 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.740316+0000", 2019-12-24T22:09:56.877 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 1.5797000000000001e-05 2019-12-24T22:09:56.877 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.878 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.878 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "queued_for_pg", 2019-12-24T22:09:56.878 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.740332+0000", 2019-12-24T22:09:56.878 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 7.5963000000000004e-05 2019-12-24T22:09:56.878 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.878 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.879 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "reached_pg", 2019-12-24T22:09:56.879 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.740408+0000", 2019-12-24T22:09:56.879 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 4.5834999999999997e-05 2019-12-24T22:09:56.879 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.879 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.879 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "done", 2019-12-24T22:09:56.880 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.740454+0000", 2019-12-24T22:09:56.880 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0.00015851099999999999 2019-12-24T22:09:56.880 INFO:teuthology.orchestra.run.smithi037.stdout: } 2019-12-24T22:09:56.880 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2019-12-24T22:09:56.880 INFO:teuthology.orchestra.run.smithi037.stdout: } 2019-12-24T22:09:56.880 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.881 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.881 INFO:teuthology.orchestra.run.smithi037.stdout: "description": "MOSDScrubReserve(1.7 RELEASE e91)", 2019-12-24T22:09:56.881 INFO:teuthology.orchestra.run.smithi037.stdout: "initiated_at": "2019-12-24T22:07:04.741762+0000", 2019-12-24T22:09:56.881 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 172.12846817100001, 2019-12-24T22:09:56.881 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 7.0251000000000002e-05, 2019-12-24T22:09:56.881 INFO:teuthology.orchestra.run.smithi037.stdout: "type_data": { 2019-12-24T22:09:56.882 INFO:teuthology.orchestra.run.smithi037.stdout: "flag_point": "started", 2019-12-24T22:09:56.882 INFO:teuthology.orchestra.run.smithi037.stdout: "events": [ 2019-12-24T22:09:56.882 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.882 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "initiated", 2019-12-24T22:09:56.882 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.741762+0000", 2019-12-24T22:09:56.882 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 0 2019-12-24T22:09:56.882 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.883 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.883 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "throttled", 2019-12-24T22:09:56.883 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.741762+0000", 2019-12-24T22:09:56.883 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 1.3340000000000001e-06 2019-12-24T22:09:56.883 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.883 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.884 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "header_read", 2019-12-24T22:09:56.884 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.741763+0000", 2019-12-24T22:09:56.884 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 1.9609999999999999e-06 2019-12-24T22:09:56.884 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.884 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.884 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "all_read", 2019-12-24T22:09:56.884 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.741765+0000", 2019-12-24T22:09:56.885 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 1.0991e-05 2019-12-24T22:09:56.885 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.885 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.885 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "dispatched", 2019-12-24T22:09:56.885 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.741776+0000", 2019-12-24T22:09:56.885 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 4.9169999999999997e-06 2019-12-24T22:09:56.886 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.886 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.886 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "queued_for_pg", 2019-12-24T22:09:56.886 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.741781+0000", 2019-12-24T22:09:56.886 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 2.9886000000000002e-05 2019-12-24T22:09:56.886 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.887 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.887 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "reached_pg", 2019-12-24T22:09:56.887 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.741811+0000", 2019-12-24T22:09:56.887 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 1.6466000000000001e-05 2019-12-24T22:09:56.887 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.887 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.887 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "started", 2019-12-24T22:09:56.888 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.741827+0000", 2019-12-24T22:09:56.888 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 4.6959999999999996e-06 2019-12-24T22:09:56.888 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2019-12-24T22:09:56.888 INFO:teuthology.orchestra.run.smithi037.stdout: { 2019-12-24T22:09:56.888 INFO:teuthology.orchestra.run.smithi037.stdout: "event": "done", 2019-12-24T22:09:56.888 INFO:teuthology.orchestra.run.smithi037.stdout: "time": "2019-12-24T22:07:04.741832+0000", 2019-12-24T22:09:56.889 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 7.0251000000000002e-05 2019-12-24T22:09:56.889 INFO:teuthology.orchestra.run.smithi037.stdout: } 2019-12-24T22:09:56.889 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2019-12-24T22:09:56.889 INFO:teuthology.orchestra.run.smithi037.stdout: } 2019-12-24T22:09:56.889 INFO:teuthology.orchestra.run.smithi037.stdout: } 2019-12-24T22:09:56.889 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2019-12-24T22:09:56.890 INFO:teuthology.orchestra.run.smithi037.stdout:} 2019-12-24T22:09:57.369 INFO:teuthology.orchestra.run.smithi037.stderr:nodeep-scrub is unset 2019-12-24T22:09:57.434 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-24T22:09:59.618 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2019-12-24T22:09:59.618 INFO:teuthology.orchestra.run.smithi037.stdout: "ops": [], 2019-12-24T22:09:59.619 INFO:teuthology.orchestra.run.smithi037.stdout: "num_ops": 0 2019-12-24T22:09:59.619 INFO:teuthology.orchestra.run.smithi037.stdout:} 2019-12-24T22:10:00.197 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-24T22:10:02.275 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2019-12-24T22:10:02.275 INFO:teuthology.orchestra.run.smithi037.stdout: "ops": [], 2019-12-24T22:10:02.276 INFO:teuthology.orchestra.run.smithi037.stdout: "complaint_time": 30, 2019-12-24T22:10:02.276 INFO:teuthology.orchestra.run.smithi037.stdout: "num_blocked_ops": 0 2019-12-24T22:10:02.276 INFO:teuthology.orchestra.run.smithi037.stdout:} 2019-12-24T22:10:02.882 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-24T22:10:04.922 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2019-12-24T22:10:04.922 INFO:teuthology.orchestra.run.smithi037.stdout: "size": 20, 2019-12-24T22:10:04.922 INFO:teuthology.orchestra.run.smithi037.stdout: "duration": 600, 2019-12-24T22:10:04.922 INFO:teuthology.orchestra.run.smithi037.stdout: "ops": [] 2019-12-24T22:10:04.922 INFO:teuthology.orchestra.run.smithi037.stdout:} 2019-12-24T22:10:05.494 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-24T22:10:07.627 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:10:08.166 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:10:08.167 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-24T22:10:10.231 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:10:10.774 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:10:10.774 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-24T22:10:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:10:13.441 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:10:13.442 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-24T22:10:15.471 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:10:16.034 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:10:16.034 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-24T22:10:18.066 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:10:18.611 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:10:18.612 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-24T22:10:20.675 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:10:21.192 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:10:21.192 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-24T22:10:23.230 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:10:23.783 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:10:23.783 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-24T22:10:25.881 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:10:26.383 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:10:26.384 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-24T22:10:28.517 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:10:29.075 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:10:29.076 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-24T22:10:31.163 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:10:31.684 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:10:31.684 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-24T22:10:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:10:34.351 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:10:34.352 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-24T22:10:36.376 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:10:36.938 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:10:36.938 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-24T22:10:39.013 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:10:39.586 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:10:39.586 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-24T22:10:41.712 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:10:42.229 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:10:42.229 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-24T22:10:44.324 INFO:teuthology.orchestra.run.smithi037.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-24T22:10:44.911 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-24T22:10:44.911 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2019-12-24T22:10:44.911 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2019-12-24T22:10:44.912 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:10:47.266 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:10:47.267 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":185,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:10:36.380931+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:14.153981+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:32.596926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:09:54.894222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:15.486630+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:32.927240+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:09:53.128031+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:13.855571+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:35.425368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:09:55.135541+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:34.667166+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:09:53.971418+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:10:50.807 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:10:53.168 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:10:53.169 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":185,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:10:36.380931+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:14.153981+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:32.596926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:09:54.894222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:15.486630+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:32.927240+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:09:53.128031+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:13.855571+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:35.425368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:09:55.135541+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:34.667166+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:09:53.971418+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:10:56.725 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:10:58.970 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:10:58.971 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":188,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:10:56.207343+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:14.153981+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:32.596926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.229694+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:15.486630+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:32.927240+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:10:53.884586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:13.855571+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:35.425368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.957291+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:34.667166+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:53.980104+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:11:02.512 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:11:04.777 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:11:04.778 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":189,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:10:59.381247+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:14.153981+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:32.596926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.229694+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:15.486630+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:32.927240+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:10:53.884586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:13.855571+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:35.425368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.957291+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:34.667166+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:53.980104+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:11:08.284 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:11:10.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:11:10.552 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":189,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:10:59.381247+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:14.153981+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:32.596926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.229694+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:15.486630+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:32.927240+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:10:53.884586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:13.855571+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:35.425368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.957291+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:34.667166+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:53.980104+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:11:14.074 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:11:16.336 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:11:16.336 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":190,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:11:15.392465+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.024214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:32.596926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.229694+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:15.486630+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:32.927240+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:10:53.884586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:14.649643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:35.425368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.957291+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:34.667166+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:53.980104+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:11:19.857 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:11:22.095 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:11:22.095 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":191,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:11:16.401641+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.024214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:32.596926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.229694+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.634813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:32.927240+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:10:53.884586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:14.649643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:35.425368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.957291+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:34.667166+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:53.980104+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:11:25.676 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:11:27.914 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:11:27.914 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":191,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:11:16.401641+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.024214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:32.596926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.229694+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.634813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:32.927240+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:10:53.884586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:14.649643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:35.425368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.957291+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:34.667166+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:53.980104+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:11:31.445 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:11:33.695 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:11:33.695 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":192,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:11:33.202414+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.024214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:32.944801+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.229694+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.634813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:33.041431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:10:53.884586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:14.649643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:35.425368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.957291+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:34.667166+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:53.980104+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:11:37.225 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:11:39.369 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:11:39.369 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":194,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:11:36.402338+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.024214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:32.944801+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.229694+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.634813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:33.041431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:10:53.884586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:14.649643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:35.884860+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.957291+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:35.534826+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:53.980104+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:11:42.884 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:11:45.158 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:11:45.159 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":195,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:11:39.399251+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.024214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:32.944801+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.229694+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.634813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:33.041431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:10:53.884586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:14.649643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:35.884860+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.957291+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:35.534826+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:53.980104+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:11:48.703 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:11:50.962 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:11:50.963 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":195,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:11:39.399251+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.024214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:32.944801+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.229694+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.634813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:33.041431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:10:53.884586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:14.649643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:35.884860+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.957291+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:35.534826+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:53.980104+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:11:54.486 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:11:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:11:56.745 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":199,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:11:56.419363+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.024214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:32.944801+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:55.998277+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.634813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:33.041431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:11:54.747592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:14.649643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:35.884860+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:10:55.957291+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:35.534826+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:54.140216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:12:00.303 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:12:02.625 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:12:02.625 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":201,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:11:59.409479+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.024214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:32.944801+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:55.998277+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.634813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:33.041431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:11:54.747592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:14.649643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:35.884860+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:56.640340+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:35.534826+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:54.140216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:12:06.202 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:12:08.474 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:12:08.474 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":201,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:11:59.409479+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.024214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:32.944801+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:55.998277+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.634813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:33.041431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:11:54.747592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:14.649643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:35.884860+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:56.640340+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:35.534826+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:54.140216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:12:11.993 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:12:14.354 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:12:14.355 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":201,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:11:59.409479+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.024214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:32.944801+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:55.998277+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:15.634813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:33.041431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:11:54.747592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:14.649643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:35.884860+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:56.640340+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:35.534826+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:54.140216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:12:17.905 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:12:20.248 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:12:20.248 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":203,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:12:16.422269+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:15.246251+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:32.944801+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:55.998277+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:16.408647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:33.041431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:11:54.747592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:14.755746+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:35.884860+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:56.640340+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:35.534826+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:54.140216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:12:23.813 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:12:26.078 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:12:26.078 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":203,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:12:16.422269+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:15.246251+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:32.944801+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:55.998277+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:16.408647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:33.041431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:11:54.747592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:14.755746+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:35.884860+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:56.640340+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:35.534826+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:54.140216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:12:29.622 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:12:31.784 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:12:31.784 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":203,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:12:16.422269+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:15.246251+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:32.944801+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:55.998277+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:16.408647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:33.041431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:11:54.747592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:14.755746+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:35.884860+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:56.640340+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:35.534826+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:54.140216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:12:35.306 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:12:37.574 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:12:37.574 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":207,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:12:36.870436+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:15.246251+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:32.991661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:55.998277+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:16.408647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:33.646060+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:11:54.747592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:14.755746+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:36.674851+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:56.640340+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:35.626927+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:54.140216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:12:41.115 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:12:43.359 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:12:43.359 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":207,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:12:36.870436+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:15.246251+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:32.991661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:55.998277+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:16.408647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:33.646060+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:11:54.747592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:14.755746+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:36.674851+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:56.640340+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:35.626927+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:54.140216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:12:46.954 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:12:49.356 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:12:49.357 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":207,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:12:36.870436+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:15.246251+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:32.991661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:55.998277+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:16.408647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:33.646060+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:11:54.747592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:14.755746+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:36.674851+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:56.640340+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:35.626927+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:54.140216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:12:52.896 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:12:55.280 INFO:teuthology.orchestra.run.smithi037.stderr:2019-12-24T22:12:55.286+0000 7f34196b7700 0 --2- 172.21.15.37:0/3999291833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3414065ab0 0x7f3414065ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-24T22:12:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:12:55.496 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":208,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:12:55.219855+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:15.246251+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:32.991661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:55.998277+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:16.408647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:33.646060+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:11:54.747592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:14.755746+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:36.674851+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:11:56.640340+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:35.626927+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:54.369230+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:12:59.037 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:13:01.273 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:13:01.273 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":211,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:12:59.437072+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:15.246251+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:32.991661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:56.330660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:16.408647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:33.646060+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:12:55.715313+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:14.755746+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:36.674851+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:57.458214+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:35.626927+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:54.369230+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:13:04.831 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:13:07.102 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:13:07.102 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":211,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:12:59.437072+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:15.246251+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:32.991661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:56.330660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:16.408647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:33.646060+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:12:55.715313+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:14.755746+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:36.674851+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:57.458214+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:35.626927+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:54.369230+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:13:10.652 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:13:12.936 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:13:12.936 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":211,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:12:59.437072+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:15.246251+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:32.991661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:56.330660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:16.408647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:33.646060+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:12:55.715313+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:14.755746+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:36.674851+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:57.458214+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:35.626927+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:54.369230+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:13:16.507 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:13:18.786 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:13:18.786 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":214,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:13:17.468644+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.203721+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:32.991661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:56.330660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.575440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:33.646060+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:12:55.715313+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:14.802815+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:36.674851+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:57.458214+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:35.626927+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:54.369230+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:13:22.307 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:13:24.600 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:13:24.600 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":215,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:13:19.446087+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.203721+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:32.991661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:56.330660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.575440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:33.646060+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:12:55.715313+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:14.802815+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:36.674851+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:57.458214+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:35.626927+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:54.369230+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:13:28.130 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:13:30.376 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:13:30.376 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":215,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:13:19.446087+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.203721+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:32.991661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:56.330660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.575440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:33.646060+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:12:55.715313+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:14.802815+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:36.674851+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:57.458214+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:35.626927+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:54.369230+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:13:33.966 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:13:36.262 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:13:36.263 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":218,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:13:35.802864+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.203721+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.739540+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:56.330660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.575440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.979518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:12:55.715313+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:14.802815+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:36.674851+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:57.458214+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:35.689546+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:54.369230+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:13:39.805 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:13:42.078 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:13:42.079 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":219,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:13:36.810712+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.203721+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.739540+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:56.330660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.575440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.979518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:12:55.715313+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:14.802815+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:36.775691+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:57.458214+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:35.689546+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:54.369230+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:13:45.632 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:13:47.961 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:13:47.961 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":219,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:13:36.810712+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.203721+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.739540+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:56.330660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.575440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.979518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:12:55.715313+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:14.802815+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:36.775691+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:57.458214+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:35.689546+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:54.369230+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:13:51.506 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:13:53.810 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:13:53.811 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":219,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:13:36.810712+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.203721+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.739540+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:56.330660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.575440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.979518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:12:55.715313+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:14.802815+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:36.775691+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:57.458214+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:35.689546+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:12:54.369230+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:13:57.305 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:13:59.589 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:13:59.589 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":223,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:13:58.486318+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.203721+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.739540+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:56.759589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.575440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.979518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:13:55.735192+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:14.802815+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:36.775691+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:58.400819+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:35.689546+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:54.627384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:14:03.125 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:14:05.303 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:14:05.304 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":223,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:13:58.486318+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.203721+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.739540+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:56.759589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.575440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.979518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:13:55.735192+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:14.802815+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:36.775691+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:58.400819+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:35.689546+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:54.627384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:14:08.807 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:14:11.081 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:14:11.081 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":223,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:13:58.486318+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.203721+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.739540+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:56.759589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.575440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.979518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:13:55.735192+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:14.802815+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:36.775691+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:58.400819+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:35.689546+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:54.627384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:14:14.639 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:14:16.866 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:14:16.866 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":224,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:14:16.479140+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.203721+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.739540+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:56.759589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:16.575440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.979518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:13:55.735192+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:15.582427+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:36.775691+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:58.400819+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:35.689546+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:54.627384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:14:20.405 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:14:22.712 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:14:22.713 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":225,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:14:17.486588+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:16.993840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.739540+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:56.759589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:17.409300+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.979518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:13:55.735192+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:15.582427+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:36.775691+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:58.400819+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:35.689546+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:54.627384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:14:26.258 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:14:28.587 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:14:28.587 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":225,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:14:17.486588+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:16.993840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.739540+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:56.759589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:17.409300+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.979518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:13:55.735192+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:15.582427+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:36.775691+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:58.400819+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:35.689546+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:54.627384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:14:32.125 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:14:34.442 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:14:34.442 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":225,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:14:17.486588+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:16.993840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.739540+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:56.759589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:17.409300+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:33.979518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:13:55.735192+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:15.582427+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:36.775691+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:58.400819+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:35.689546+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:54.627384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:14:37.959 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:14:40.202 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:14:40.202 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":227,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:14:37.495916+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:16.993840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:34.577470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:56.759589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:17.409300+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:34.483112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:13:55.735192+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:15.582427+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:36.802147+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:58.400819+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:36.619301+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:54.627384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:14:43.728 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:14:46.008 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:14:46.009 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":227,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:14:37.495916+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:16.993840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:34.577470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:56.759589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:17.409300+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:34.483112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:13:55.735192+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:15.582427+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:36.802147+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:58.400819+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:36.619301+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:54.627384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:14:49.565 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:14:51.860 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:14:51.860 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":227,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:14:37.495916+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:16.993840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:34.577470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:56.759589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:17.409300+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:34.483112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:13:55.735192+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:15.582427+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:36.802147+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:58.400819+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:36.619301+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:54.627384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:14:55.366 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:14:57.661 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:14:57.661 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":229,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:14:57.512414+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:16.993840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:34.577470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:57.077234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:17.409300+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:34.483112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:14:56.629367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:15.582427+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:36.802147+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:13:58.400819+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:36.619301+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:54.835583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:15:01.183 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:15:03.448 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:15:03.448 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":230,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:14:59.522953+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:16.993840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:34.577470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:57.077234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:17.409300+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:34.483112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:14:56.629367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:15.582427+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:36.802147+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:59.418795+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:36.619301+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:54.835583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:15:06.967 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:15:09.434 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:15:09.435 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":231,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:15:04.495655+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:16.993840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:34.577470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:57.077234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:17.409300+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:34.483112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:14:56.629367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:15.582427+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:36.802147+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:59.418795+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:36.619301+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:54.835583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:15:12.957 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:15:15.204 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:15:15.204 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":231,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:15:04.495655+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:16.993840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:34.577470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:57.077234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:17.409300+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:34.483112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:14:56.629367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:15.582427+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:36.802147+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:59.418795+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:36.619301+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:54.835583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:15:18.726 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:15:21.039 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:15:21.040 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":235,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:15:19.503912+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.983858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:34.577470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:57.077234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.476362+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:34.483112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:14:56.629367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:15.901161+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:36.802147+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:59.418795+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:36.619301+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:54.835583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:15:24.586 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:15:26.866 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:15:26.866 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":235,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:15:19.503912+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.983858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:34.577470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:57.077234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.476362+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:34.483112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:14:56.629367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:15.901161+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:36.802147+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:59.418795+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:36.619301+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:54.835583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:15:30.415 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:15:32.738 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:15:32.738 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":235,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:15:19.503912+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.983858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:34.577470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:57.077234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.476362+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:34.483112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:14:56.629367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:15.901161+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:36.802147+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:59.418795+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:36.619301+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:54.835583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:15:36.280 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:15:38.563 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:15:38.564 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":238,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:15:38.534709+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.983858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:34.955213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:57.077234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.476362+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:35.376011+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:14:56.629367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:15.901161+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.681772+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:59.418795+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.203314+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:54.835583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:15:42.122 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:15:44.389 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:15:44.389 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":239,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:15:39.512412+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.983858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:34.955213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:57.077234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.476362+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:35.376011+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:14:56.629367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:15.901161+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.681772+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:59.418795+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.203314+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:54.835583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:15:47.921 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:15:50.065 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:15:50.065 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":239,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:15:39.512412+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.983858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:34.955213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:57.077234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.476362+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:35.376011+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:14:56.629367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:15.901161+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.681772+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:59.418795+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.203314+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:54.835583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:15:53.562 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:15:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:15:55.830 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":240,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:15:55.526380+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.983858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:34.955213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:57.077234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.476362+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:35.376011+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:14:56.629367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:15.901161+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.681772+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:14:59.418795+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.203314+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:55.380590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:15:59.347 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:16:01.561 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:16:01.563 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":242,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:16:00.557679+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.983858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:34.955213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:57.374568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.476362+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:35.376011+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:15:56.726349+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:15.901161+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.681772+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:59.583967+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.203314+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:55.380590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:16:05.099 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:16:07.448 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:16:07.448 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":243,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:16:04.526357+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.983858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:34.955213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:57.374568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.476362+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:35.376011+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:15:56.726349+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:15.901161+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.681772+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:59.583967+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.203314+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:55.380590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:16:10.981 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:16:13.231 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:16:13.232 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":243,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:16:04.526357+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.983858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:34.955213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:57.374568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.476362+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:35.376011+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:15:56.726349+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:15.901161+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.681772+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:59.583967+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.203314+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:55.380590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:16:16.784 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:16:19.074 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:16:19.074 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":245,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:16:18.543999+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:17.983858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:34.955213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:57.374568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.383903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:35.376011+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:15:56.726349+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:16.689111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.681772+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:59.583967+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.203314+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:55.380590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:16:22.651 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:16:24.922 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:16:24.922 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":247,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:16:24.536105+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.827332+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:34.955213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:57.374568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.383903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:35.376011+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:15:56.726349+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:16.689111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.681772+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:59.583967+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.203314+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:55.380590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:16:28.470 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:16:30.725 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:16:30.726 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":247,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:16:24.536105+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.827332+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:34.955213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:57.374568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.383903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:35.376011+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:15:56.726349+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:16.689111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.681772+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:59.583967+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.203314+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:55.380590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:16:34.276 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:16:36.595 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:16:36.595 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":248,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:16:36.553200+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.827332+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:35.696340+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:57.374568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.383903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:36.232349+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:15:56.726349+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:16.689111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.681772+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:59.583967+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:37.203314+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:55.380590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:16:40.176 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:16:42.481 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:16:42.481 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":250,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:16:39.572335+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.827332+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:35.696340+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:57.374568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.383903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:36.232349+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:15:56.726349+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:16.689111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:38.713400+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:59.583967+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:37.996753+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:55.380590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:16:46.034 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:16:48.268 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:16:48.268 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":251,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:16:44.545424+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.827332+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:35.696340+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:57.374568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.383903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:36.232349+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:15:56.726349+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:16.689111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:38.713400+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:59.583967+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:37.996753+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:55.380590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:16:51.802 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:16:54.111 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:16:54.112 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":251,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:16:44.545424+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.827332+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:35.696340+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:57.374568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.383903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:36.232349+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:15:56.726349+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:16.689111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:38.713400+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:59.583967+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:37.996753+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:55.380590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:16:57.650 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:16:59.880 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:16:59.881 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":253,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:16:58.568722+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.827332+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:35.696340+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:57.581396+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.383903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:36.232349+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:16:57.675468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:16.689111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:38.713400+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:15:59.583967+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:37.996753+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:56.203354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:17:03.431 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:17:05.731 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:17:05.732 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":255,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:17:04.556246+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.827332+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:35.696340+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:57.581396+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.383903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:36.232349+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:16:57.675468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:16.689111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:38.713400+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:00.400697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:37.996753+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:56.203354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:17:09.285 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:17:11.498 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:17:11.498 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":255,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:17:04.556246+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.827332+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:35.696340+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:57.581396+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.383903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:36.232349+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:16:57.675468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:16.689111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:38.713400+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:00.400697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:37.996753+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:56.203354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:17:15.069 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:17:17.358 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:17:17.358 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":255,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:17:04.556246+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.827332+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:35.696340+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:57.581396+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:18.383903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:36.232349+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:16:57.675468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:16.689111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:38.713400+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:00.400697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:37.996753+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:56.203354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:17:20.968 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:17:23.360 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:17:23.361 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":257,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:17:19.563409+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:19.138641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:35.696340+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:57.581396+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:19.415475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:36.232349+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:16:57.675468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:17.377273+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:38.713400+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:00.400697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:37.996753+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:56.203354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:17:26.912 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:17:29.165 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:17:29.166 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":257,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:17:19.563409+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:19.138641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:35.696340+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:57.581396+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:19.415475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:36.232349+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:16:57.675468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:17.377273+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:38.713400+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:00.400697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:37.996753+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:56.203354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:17:32.710 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:17:34.875 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:17:34.875 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":257,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:17:19.563409+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:19.138641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:35.696340+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:57.581396+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:19.415475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:36.232349+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:16:57.675468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:17.377273+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:38.713400+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:00.400697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:37.996753+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:56.203354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:17:38.399 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:17:40.686 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:17:40.686 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":261,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:17:39.574238+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:19.138641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:35.884073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:57.581396+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:19.415475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:37.157527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:16:57.675468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:17.377273+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:39.015508+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:00.400697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:38.414474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:56.203354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:17:44.249 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:17:46.579 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:17:46.580 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":261,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:17:39.574238+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:19.138641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:35.884073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:57.581396+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:19.415475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:37.157527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:16:57.675468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:17.377273+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:39.015508+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:00.400697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:38.414474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:56.203354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:17:50.138 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:17:52.403 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:17:52.404 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":261,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:17:39.574238+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:19.138641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:35.884073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:57.581396+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:19.415475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:37.157527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:16:57.675468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:17.377273+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:39.015508+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:00.400697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:38.414474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:56.203354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:17:55.961 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:17:58.158 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:17:58.159 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":262,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:17:57.590159+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:19.138641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:35.884073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:16:57.581396+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:19.415475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:37.157527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:16:57.675468+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:17.377273+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:39.015508+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:00.400697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:38.414474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.179158+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:18:01.704 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:18:03.905 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:18:03.906 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":264,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:18:01.613120+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:19.138641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:35.884073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.712645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:19.415475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:37.157527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:17:58.578306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:17.377273+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:39.015508+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:01.187204+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:38.414474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.179158+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:18:07.406 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:18:09.725 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:18:09.726 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":265,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:18:04.586271+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:19.138641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:35.884073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.712645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:19.415475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:37.157527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:17:58.578306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:17.377273+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:39.015508+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:01.187204+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:38.414474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.179158+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:18:13.281 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:18:15.434 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:18:15.435 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":265,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:18:04.586271+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:19.138641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:35.884073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.712645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:19.415475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:37.157527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:17:58.578306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:17.377273+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:39.015508+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:01.187204+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:38.414474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.179158+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:18:18.965 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:18:21.270 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:18:21.270 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":268,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:18:20.605944+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:19.940556+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:35.884073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.712645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:20.235296+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:37.157527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:17:58.578306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:17.453342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:39.015508+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:01.187204+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:38.414474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.179158+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:18:24.808 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:18:27.160 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:18:27.160 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":269,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:18:24.597085+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:19.940556+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:35.884073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.712645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:20.235296+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:37.157527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:17:58.578306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:17.453342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:39.015508+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:01.187204+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:38.414474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.179158+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:18:30.721 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:18:33.230 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:18:33.231 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":269,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:18:24.597085+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:19.940556+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:35.884073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.712645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:20.235296+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:37.157527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:17:58.578306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:17.453342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:39.015508+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:01.187204+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:38.414474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.179158+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:18:36.771 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:18:38.980 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:18:38.980 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":271,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:18:38.623712+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:19.940556+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:35.985364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.712645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:20.235296+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.100972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:17:58.578306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:17.453342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:39.015508+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:01.187204+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:38.414474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.179158+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:18:42.539 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:18:44.708 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:18:44.709 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":273,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:18:40.639559+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:19.940556+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:35.985364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.712645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:20.235296+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.100972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:17:58.578306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:17.453342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:40.016282+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:01.187204+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.914681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.179158+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:18:48.322 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:18:50.610 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:18:50.610 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":273,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:18:40.639559+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:19.940556+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:35.985364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.712645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:20.235296+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.100972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:17:58.578306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:17.453342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:40.016282+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:01.187204+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.914681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.179158+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:18:54.249 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:18:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:18:56.434 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":273,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:18:40.639559+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:19.940556+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:35.985364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.712645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:20.235296+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.100972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:17:58.578306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:17.453342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:40.016282+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:01.187204+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.914681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:17:57.179158+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:19:00.009 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:19:02.171 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:19:02.171 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":277,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:19:01.858746+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:19.940556+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:35.985364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:57.988636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:20.235296+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.100972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:18:59.473714+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:17.453342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:40.016282+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:01.809232+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.914681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:57.295398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:19:05.767 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:19:08.063 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:19:08.063 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":277,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:19:01.858746+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:19.940556+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:35.985364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:57.988636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:20.235296+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.100972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:18:59.473714+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:17.453342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:40.016282+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:01.809232+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.914681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:57.295398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:19:11.607 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:19:13.900 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:19:13.900 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":277,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:19:01.858746+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:19.940556+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:35.985364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:57.988636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:20.235296+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.100972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:18:59.473714+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:17.453342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:40.016282+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:01.809232+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.914681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:57.295398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:19:17.445 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:19:19.675 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:19:19.676 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":279,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:19:19.623662+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:19.940556+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:35.985364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:57.988636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:20.235296+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.100972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:18:59.473714+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:18.299748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:40.016282+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:01.809232+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.914681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:57.295398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:19:23.200 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:19:25.399 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:19:25.400 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":281,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:19:21.644872+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:20.095606+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:35.985364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:57.988636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:20.814132+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.100972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:18:59.473714+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:18.299748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:40.016282+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:01.809232+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.914681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:57.295398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:19:28.975 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:19:31.257 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:19:31.257 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":281,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:19:21.644872+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:20.095606+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:35.985364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:57.988636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:20.814132+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.100972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:18:59.473714+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:18.299748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:40.016282+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:01.809232+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.914681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:57.295398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:19:34.794 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:19:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:19:37.044 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":281,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:19:21.644872+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:20.095606+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:35.985364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:57.988636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:20.814132+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.100972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:18:59.473714+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:18.299748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:40.016282+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:01.809232+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:38.914681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:57.295398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:19:40.586 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:19:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:19:42.884 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":284,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:19:40.671644+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:20.095606+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:36.983097+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:57.988636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:20.814132+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:39.085053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:18:59.473714+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:18.299748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:40.284097+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:01.809232+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:39.262330+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:57.295398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:19:46.432 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:19:48.631 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:19:48.632 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":285,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:19:44.644944+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:20.095606+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:36.983097+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:57.988636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:20.814132+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:39.085053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:18:59.473714+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:18.299748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:40.284097+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:01.809232+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:39.262330+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:57.295398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:19:52.147 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:19:54.439 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:19:54.439 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":285,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:19:44.644944+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:20.095606+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:36.983097+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:57.988636+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:20.814132+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:39.085053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:18:59.473714+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:18.299748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:40.284097+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:01.809232+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:39.262330+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:18:57.295398+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:19:57.985 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:20:00.306 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:20:00.307 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":287,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:19:59.103176+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:20.095606+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:36.983097+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.048479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:20.814132+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:39.085053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:18:59.473714+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:18.299748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:40.284097+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:01.809232+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:39.262330+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.228924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:20:03.885 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:20:06.241 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:20:06.242 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":289,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:20:02.120833+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:20.095606+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:36.983097+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.048479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:20.814132+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:39.085053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:20:00.338356+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:18.299748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:40.284097+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:02.023675+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:39.262330+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.228924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:20:09.769 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:20:12.022 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:20:12.022 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":289,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:20:02.120833+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:20.095606+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:36.983097+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.048479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:20.814132+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:39.085053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:20:00.338356+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:18.299748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:40.284097+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:02.023675+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:39.262330+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.228924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:20:15.551 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:20:17.780 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:20:17.780 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":289,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:20:02.120833+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:20.095606+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:36.983097+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.048479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:20.814132+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:39.085053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:20:00.338356+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:18.299748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:40.284097+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:02.023675+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:39.262330+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.228924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:20:21.378 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:20:23.725 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:20:23.725 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":292,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:20:21.862650+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.228148+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:36.983097+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.048479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.869708+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:39.085053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:20:00.338356+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:18.974568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:40.284097+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:02.023675+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:39.262330+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.228924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:20:27.276 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:20:29.526 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:20:29.527 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":293,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:20:24.667725+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.228148+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:36.983097+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.048479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.869708+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:39.085053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:20:00.338356+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:18.974568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:40.284097+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:02.023675+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:39.262330+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.228924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:20:33.057 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:20:35.354 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:20:35.354 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":293,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:20:24.667725+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.228148+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:36.983097+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.048479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.869708+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:39.085053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:20:00.338356+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:18.974568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:40.284097+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:02.023675+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:39.262330+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.228924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:20:38.895 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:20:41.091 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:20:41.091 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":296,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:20:40.697152+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.228148+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:37.208338+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.048479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.869708+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:39.138779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:20:00.338356+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:18.974568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.329123+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:02.023675+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.098961+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.228924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:20:44.604 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:20:46.786 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:20:46.786 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":297,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:20:44.678452+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.228148+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:37.208338+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.048479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.869708+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:39.138779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:20:00.338356+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:18.974568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.329123+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:02.023675+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.098961+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.228924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:20:50.318 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:20:52.607 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:20:52.608 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":297,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:20:44.678452+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.228148+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:37.208338+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.048479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.869708+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:39.138779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:20:00.338356+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:18.974568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.329123+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:02.023675+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.098961+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.228924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:20:56.134 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:20:58.400 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:20:58.400 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":297,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:20:44.678452+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.228148+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:37.208338+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.048479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.869708+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:39.138779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:20:00.338356+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:18.974568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.329123+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:02.023675+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.098961+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:19:58.228924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:21:01.937 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:21:04.212 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:21:04.213 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":301,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:21:03.708176+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.228148+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:37.208338+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:58.855707+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.869708+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:39.138779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:21:00.951521+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:18.974568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.329123+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:03.010542+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.098961+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:58.587045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:21:07.755 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:21:09.933 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:21:09.934 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":301,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:21:03.708176+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.228148+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:37.208338+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:58.855707+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.869708+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:39.138779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:21:00.951521+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:18.974568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.329123+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:03.010542+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.098961+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:58.587045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:21:13.480 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:21:15.773 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:21:15.773 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":301,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:21:03.708176+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.228148+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:37.208338+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:58.855707+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.869708+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:39.138779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:21:00.951521+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:18.974568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.329123+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:03.010542+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.098961+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:58.587045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:21:19.312 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:21:21.486 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:21:21.486 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":302,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:21:20.699897+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.228148+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:37.208338+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:58.855707+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:20.869708+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:39.138779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:21:00.951521+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:19.905131+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.329123+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:03.010542+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.098961+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:58.587045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:21:25.072 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:21:27.336 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:21:27.336 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":303,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:21:21.708809+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:20.917837+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:37.208338+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:58.855707+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:20.958344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:39.138779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:21:00.951521+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:19.905131+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.329123+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:03.010542+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.098961+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:58.587045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:21:30.878 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:21:33.133 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:21:33.133 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":303,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:21:21.708809+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:20.917837+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:37.208338+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:58.855707+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:20.958344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:39.138779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:21:00.951521+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:19.905131+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.329123+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:03.010542+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.098961+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:58.587045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:21:36.645 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:21:38.919 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:21:38.920 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":304,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:21:37.711393+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:20.917837+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:37.231575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:58.855707+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:20.958344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:39.138779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:21:00.951521+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:19.905131+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.329123+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:03.010542+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:40.098961+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:58.587045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:21:42.518 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:21:44.702 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:21:44.702 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":307,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:21:44.707953+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:20.917837+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:37.231575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:58.855707+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:20.958344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:39.380597+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:21:00.951521+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:19.905131+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:40.376909+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:03.010542+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:40.253060+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:58.587045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:21:48.222 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:21:50.527 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:21:50.528 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":307,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:21:44.707953+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:20.917837+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:37.231575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:58.855707+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:20.958344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:39.380597+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:21:00.951521+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:19.905131+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:40.376909+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:03.010542+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:40.253060+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:58.587045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:21:54.073 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:21:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:21:56.391 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":307,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:21:44.707953+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:20.917837+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:37.231575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:58.855707+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:20.958344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:39.380597+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:21:00.951521+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:19.905131+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:40.376909+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:03.010542+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:40.253060+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:20:58.587045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:21:59.923 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:22:02.152 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:22:02.153 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":310,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:22:01.728227+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:20.917837+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:37.231575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.253702+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:20.958344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:39.380597+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:22:01.249961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:19.905131+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:40.376909+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:03.010542+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:40.253060+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.620736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:22:05.723 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:22:08.237 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:22:08.238 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":311,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:22:03.738163+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:20.917837+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:37.231575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.253702+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:20.958344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:39.380597+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:22:01.249961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:19.905131+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:40.376909+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:03.182654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:40.253060+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.620736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:22:11.748 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:22:14.039 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:22:14.040 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":311,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:22:03.738163+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:20.917837+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:37.231575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.253702+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:20.958344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:39.380597+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:22:01.249961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:19.905131+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:40.376909+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:03.182654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:40.253060+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.620736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:22:17.555 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:22:19.837 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:22:19.838 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":311,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:22:03.738163+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:20.917837+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:37.231575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.253702+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:20.958344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:39.380597+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:22:01.249961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:19.905131+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:40.376909+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:03.182654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:40.253060+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.620736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:22:23.375 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:22:25.734 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:22:25.734 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":313,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:22:22.742521+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:21.784650+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:37.231575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.253702+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:21.003303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:39.380597+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:22:01.249961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:20.803389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:40.376909+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:03.182654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:40.253060+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.620736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:22:29.279 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:22:31.596 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:22:31.596 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":313,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:22:22.742521+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:21.784650+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:37.231575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.253702+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:21.003303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:39.380597+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:22:01.249961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:20.803389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:40.376909+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:03.182654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:40.253060+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.620736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:22:35.165 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:22:37.496 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:22:37.497 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":313,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:22:22.742521+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:21.784650+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:37.231575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.253702+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:21.003303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:39.380597+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:22:01.249961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:20.803389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:40.376909+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:03.182654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:40.253060+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.620736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:22:41.043 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:22:43.349 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:22:43.350 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":317,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:22:41.753786+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:21.784650+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:37.674831+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.253702+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:21.003303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:39.439923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:22:01.249961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:20.803389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:41.255916+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:03.182654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:40.525497+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.620736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:22:46.884 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:22:49.164 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:22:49.164 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":317,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:22:41.753786+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:21.784650+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:37.674831+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.253702+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:21.003303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:39.439923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:22:01.249961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:20.803389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:41.255916+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:03.182654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:40.525497+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.620736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:22:52.762 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:22:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:22:55.019 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":317,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:22:41.753786+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:21.784650+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:37.674831+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.253702+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:21.003303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:39.439923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:22:01.249961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:20.803389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:41.255916+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:03.182654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:40.525497+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.620736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:22:58.528 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:23:00.750 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:23:00.750 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":319,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:22:59.746547+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:21.784650+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:37.674831+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:59.267310+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:21.003303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:39.439923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:22:01.249961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:20.803389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:41.255916+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:03.182654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:40.525497+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:21:59.620736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:23:04.308 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:23:06.540 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:23:06.541 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":323,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:23:04.750494+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:21.784650+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:37.674831+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:59.267310+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:21.003303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:39.439923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:23:01.529114+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:20.803389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:41.255916+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:04.078997+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:40.525497+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:00.347395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:23:10.045 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:23:12.262 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:23:12.262 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":323,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:23:04.750494+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:21.784650+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:37.674831+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:59.267310+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:21.003303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:39.439923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:23:01.529114+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:20.803389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:41.255916+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:04.078997+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:40.525497+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:00.347395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:23:15.863 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:23:18.197 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:23:18.197 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":323,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:23:04.750494+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:21.784650+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:37.674831+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:59.267310+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:21.003303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:39.439923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:23:01.529114+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:20.803389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:41.255916+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:04.078997+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:40.525497+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:00.347395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:23:21.737 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:23:23.983 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:23:23.984 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":325,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:23:22.773482+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:22.318219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:37.674831+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:59.267310+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.117203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:39.439923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:23:01.529114+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.062177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:41.255916+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:04.078997+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:40.525497+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:00.347395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:23:27.502 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:23:29.881 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:23:29.881 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":325,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:23:22.773482+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:22.318219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:37.674831+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:59.267310+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.117203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:39.439923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:23:01.529114+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.062177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:41.255916+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:04.078997+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:40.525497+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:00.347395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:23:33.448 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:23:35.706 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:23:35.707 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":325,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:23:22.773482+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:22.318219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:37.674831+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:59.267310+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.117203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:39.439923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:23:01.529114+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.062177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:41.255916+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:04.078997+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:40.525497+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:00.347395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:23:39.262 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:23:41.547 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:23:41.548 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":328,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:23:41.379806+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:22.318219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:38.491449+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:59.267310+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.117203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:40.432883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:23:01.529114+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.062177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:41.255916+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:04.078997+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:41.266633+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:00.347395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:23:45.064 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:23:47.349 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:23:47.349 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":329,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:23:42.382881+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:22.318219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:38.491449+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:59.267310+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.117203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:40.432883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:23:01.529114+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.062177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:42.054830+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:04.078997+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:41.266633+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:00.347395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:23:50.901 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:23:53.243 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:23:53.244 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":329,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:23:42.382881+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:22.318219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:38.491449+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:59.267310+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.117203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:40.432883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:23:01.529114+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.062177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:42.054830+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:04.078997+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:41.266633+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:00.347395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:23:56.750 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:23:58.976 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:23:58.976 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":329,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:23:42.382881+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:22.318219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:38.491449+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:22:59.267310+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.117203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:40.432883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:23:01.529114+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.062177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:42.054830+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:04.078997+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:41.266633+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:00.347395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:24:02.517 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:24:04.767 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:24:04.767 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":331,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:24:02.791227+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:22.318219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:38.491449+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:59.957920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.117203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:40.432883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:24:01.975267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.062177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:42.054830+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:04.078997+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:41.266633+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:00.432045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:24:08.295 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:24:10.478 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:24:10.479 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":333,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:24:09.781338+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:22.318219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:38.491449+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:59.957920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.117203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:40.432883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:24:01.975267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.062177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:42.054830+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:04.310382+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:41.266633+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:00.432045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:24:13.999 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:24:16.257 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:24:16.258 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":333,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:24:09.781338+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:22.318219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:38.491449+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:59.957920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.117203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:40.432883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:24:01.975267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.062177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:42.054830+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:04.310382+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:41.266633+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:00.432045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:24:19.777 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:24:22.038 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:24:22.039 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":333,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:24:09.781338+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:22.318219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:38.491449+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:59.957920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.117203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:40.432883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:24:01.975267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:21.062177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:42.054830+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:04.310382+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:41.266633+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:00.432045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:24:25.574 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:24:27.788 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:24:27.788 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":335,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:24:24.111044+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:23.266869+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:38.491449+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:59.957920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:22.040734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:40.432883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:24:01.975267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:22.034340+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:42.054830+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:04.310382+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:41.266633+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:00.432045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:24:31.322 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:24:33.666 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:24:33.666 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":335,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:24:24.111044+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:23.266869+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:38.491449+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:59.957920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:22.040734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:40.432883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:24:01.975267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:22.034340+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:42.054830+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:04.310382+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:41.266633+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:00.432045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:24:37.168 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:24:39.451 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:24:39.452 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":336,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:24:39.378987+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:23.266869+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:39.141832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:59.957920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:22.040734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:40.432883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:24:01.975267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:22.034340+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:42.054830+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:04.310382+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:41.266633+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:00.432045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:24:42.968 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:24:45.178 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:24:45.178 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":341,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:24:44.799257+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:23.266869+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:39.141832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:59.957920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:22.040734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:40.669843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:24:01.975267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:22.034340+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.836603+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:04.310382+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.189651+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:00.432045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:24:48.752 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:24:50.938 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:24:50.938 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":341,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:24:44.799257+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:23.266869+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:39.141832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:59.957920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:22.040734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:40.669843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:24:01.975267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:22.034340+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.836603+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:04.310382+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.189651+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:00.432045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:24:54.437 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:24:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:24:56.822 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":341,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:24:44.799257+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:23.266869+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:39.141832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:23:59.957920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:22.040734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:40.669843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:24:01.975267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:22.034340+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.836603+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:04.310382+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.189651+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:00.432045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:25:00.354 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:25:02.678 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:25:02.678 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":342,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:25:00.817056+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:23.266869+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:39.141832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.642219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:22.040734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:40.669843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:24:01.975267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:22.034340+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.836603+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:04.310382+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.189651+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.576764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:25:06.236 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:25:08.475 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:25:08.475 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":344,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:25:04.839394+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:23.266869+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:39.141832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.642219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:22.040734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:40.669843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:25:02.363852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:22.034340+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.836603+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:04.486059+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.189651+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.576764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:25:12.010 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:25:14.324 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:25:14.324 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":345,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:25:09.811060+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:23.266869+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:39.141832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.642219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:22.040734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:40.669843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:25:02.363852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:22.034340+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.836603+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:04.486059+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.189651+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.576764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:25:17.850 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:25:20.129 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:25:20.130 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":345,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:25:09.811060+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:23.266869+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:39.141832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.642219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:22.040734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:40.669843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:25:02.363852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:22.034340+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.836603+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:04.486059+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.189651+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.576764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:25:23.702 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:25:26.039 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:25:26.039 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":348,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:25:25.176487+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:24.193193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:39.141832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.642219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.110976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:40.669843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:25:02.363852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.555512+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.836603+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:04.486059+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.189651+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.576764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:25:29.563 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:25:31.849 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:25:31.850 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":349,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:25:29.820187+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:24.193193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:39.141832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.642219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.110976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:40.669843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:25:02.363852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.555512+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.836603+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:04.486059+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.189651+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.576764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:25:35.370 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:25:37.531 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:25:37.532 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":349,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:25:29.820187+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:24.193193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:39.141832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.642219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.110976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:40.669843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:25:02.363852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.555512+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.836603+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:04.486059+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.189651+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.576764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:25:41.050 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:25:43.289 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:25:43.290 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":352,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:25:42.851723+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:24.193193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:39.979721+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.642219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.110976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:41.616729+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:25:02.363852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.555512+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:24:42.836603+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:04.486059+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:42.375259+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.576764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:25:46.871 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:25:49.127 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:25:49.128 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":353,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:25:43.859772+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:24.193193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:39.979721+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.642219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.110976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:41.616729+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:25:02.363852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.555512+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:43.738295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:04.486059+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:42.375259+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.576764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:25:52.645 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:25:54.935 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:25:54.936 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":353,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:25:43.859772+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:24.193193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:39.979721+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.642219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.110976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:41.616729+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:25:02.363852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.555512+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:43.738295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:04.486059+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:42.375259+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.576764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:25:58.475 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:26:00.695 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:26:00.695 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":353,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:25:43.859772+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:24.193193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:39.979721+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.642219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.110976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:41.616729+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:25:02.363852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.555512+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:43.738295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:04.486059+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:42.375259+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:00.576764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:26:04.238 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:26:06.462 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:26:06.462 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":357,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:26:04.837305+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:24.193193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:39.979721+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:01.225189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.110976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:41.616729+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:26:03.322591+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.555512+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:43.738295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:04.572979+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:42.375259+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:00.600487+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:26:09.970 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:26:12.290 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:26:12.291 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":357,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:26:04.837305+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:24.193193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:39.979721+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:01.225189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.110976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:41.616729+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:26:03.322591+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.555512+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:43.738295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:04.572979+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:42.375259+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:00.600487+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:26:15.847 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:26:18.072 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:26:18.072 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":357,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:26:04.837305+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:24.193193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:39.979721+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:01.225189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.110976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:41.616729+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:26:03.322591+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.555512+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:43.738295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:04.572979+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:42.375259+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:00.600487+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:26:21.674 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:26:24.016 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:26:24.017 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":358,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:26:23.401922+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:24.193193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:39.979721+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:01.225189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:22.815466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:41.616729+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:26:03.322591+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:22.555512+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:43.738295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:04.572979+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:42.375259+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:00.600487+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:26:27.534 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:26:29.798 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:26:29.798 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":359,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:26:24.405140+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:24.387528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:39.979721+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:01.225189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:22.815466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:41.616729+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:26:03.322591+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:23.509835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:43.738295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:04.572979+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:42.375259+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:00.600487+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:26:33.283 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:26:35.523 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:26:35.523 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":359,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:26:24.405140+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:24.387528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:39.979721+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:01.225189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:22.815466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:41.616729+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:26:03.322591+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:23.509835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:43.738295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:04.572979+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:42.375259+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:00.600487+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:26:39.051 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:26:41.303 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:26:41.304 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":360,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:26:40.859273+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:24.387528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:40.109584+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:01.225189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:22.815466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:41.616729+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:26:03.322591+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:23.509835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:43.738295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:04.572979+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:25:42.375259+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:00.600487+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:26:44.842 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:26:47.081 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:26:47.082 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":362,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:26:44.881397+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:24.387528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:40.109584+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:01.225189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:22.815466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:42.493023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:26:03.322591+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:23.509835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:44.245329+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:04.572979+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:42.547524+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:00.600487+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:26:50.600 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:26:52.813 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:26:52.813 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":363,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:26:49.858592+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:24.387528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:40.109584+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:01.225189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:22.815466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:42.493023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:26:03.322591+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:23.509835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:44.245329+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:04.572979+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:42.547524+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:00.600487+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:26:56.354 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:26:58.720 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:26:58.721 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":363,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:26:49.858592+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:24.387528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:40.109584+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:01.225189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:22.815466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:42.493023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:26:03.322591+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:23.509835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:44.245329+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:04.572979+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:42.547524+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:00.600487+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:27:02.275 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:27:04.464 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:27:04.464 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":365,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:27:02.880049+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:24.387528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:40.109584+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:02.170924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:22.815466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:42.493023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:26:03.322591+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:23.509835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:44.245329+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:04.572979+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:42.547524+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:00.791961+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:27:08.050 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:27:10.313 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:27:10.314 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":367,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:27:09.867946+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:24.387528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:40.109584+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:02.170924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:22.815466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:42.493023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:27:04.202767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:23.509835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:44.245329+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:04.620553+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:42.547524+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:00.791961+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:27:13.826 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:27:16.058 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:27:16.059 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":367,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:27:09.867946+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:24.387528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:40.109584+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:02.170924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:22.815466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:42.493023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:27:04.202767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:23.509835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:44.245329+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:04.620553+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:42.547524+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:00.791961+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:27:19.592 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:27:21.928 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:27:21.928 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":367,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:27:09.867946+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:24.387528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:40.109584+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:02.170924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:22.815466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:42.493023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:27:04.202767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:23.509835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:44.245329+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:04.620553+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:42.547524+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:00.791961+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:27:25.523 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:27:27.830 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:27:27.830 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":370,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:27:25.014241+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:24.472726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:40.109584+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:02.170924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:22.865038+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:42.493023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:27:04.202767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:23.614672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:44.245329+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:04.620553+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:42.547524+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:00.791961+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:27:31.375 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:27:33.642 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:27:33.642 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":371,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:27:29.877197+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:24.472726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:40.109584+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:02.170924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:22.865038+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:42.493023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:27:04.202767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:23.614672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:44.245329+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:04.620553+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:42.547524+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:00.791961+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:27:37.190 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:27:39.435 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:27:39.436 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":371,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:27:29.877197+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:24.472726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:40.109584+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:02.170924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:22.865038+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:42.493023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:27:04.202767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:23.614672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:44.245329+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:04.620553+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:26:42.547524+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:00.791961+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:27:42.982 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:27:45.233 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:27:45.234 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":374,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:27:44.903786+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:24.472726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:40.913901+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:02.170924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:22.865038+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.664816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:27:04.202767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:23.614672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:44.246105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:04.620553+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.574005+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:00.791961+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:27:48.784 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:27:50.991 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:27:50.992 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":375,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:27:49.887475+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:24.472726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:40.913901+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:02.170924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:22.865038+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.664816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:27:04.202767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:23.614672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:44.246105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:04.620553+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.574005+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:00.791961+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:27:54.500 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:27:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:27:56.787 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":375,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:27:49.887475+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:24.472726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:40.913901+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:02.170924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:22.865038+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.664816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:27:04.202767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:23.614672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:44.246105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:04.620553+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.574005+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:00.791961+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:28:00.378 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:28:02.517 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:28:02.518 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":376,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:28:01.897068+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:24.472726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:40.913901+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:02.170924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:22.865038+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.664816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:27:04.202767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:23.614672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:44.246105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:04.620553+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.574005+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:01.429252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:28:06.061 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:28:08.282 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:28:08.282 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":378,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:28:05.918967+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:24.472726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:40.913901+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:03.112443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:22.865038+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.664816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:28:05.069716+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:23.614672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:44.246105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:05.442416+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.574005+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:01.429252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:28:11.777 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:28:14.071 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:28:14.072 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":379,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:28:09.896081+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:24.472726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:40.913901+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:03.112443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:22.865038+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.664816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:28:05.069716+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:23.614672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:44.246105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:05.442416+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.574005+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:01.429252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:28:17.596 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:28:20.558 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:28:20.558 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":379,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:28:09.896081+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:24.472726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:40.913901+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:03.112443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:22.865038+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.664816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:28:05.069716+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:23.614672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:44.246105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:05.442416+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.574005+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:01.429252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:28:24.094 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:28:26.311 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:28:26.312 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":382,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:28:25.650142+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:24.878552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:40.913901+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:03.112443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.588601+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.664816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:28:05.069716+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.964655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:44.246105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:05.442416+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.574005+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:01.429252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:28:29.817 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:28:31.988 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:28:31.988 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":383,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:28:29.907200+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:24.878552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:40.913901+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:03.112443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.588601+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.664816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:28:05.069716+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.964655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:44.246105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:05.442416+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.574005+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:01.429252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:28:35.526 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:28:37.751 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:28:37.752 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":383,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:28:29.907200+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:24.878552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:40.913901+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:03.112443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.588601+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.664816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:28:05.069716+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.964655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:44.246105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:05.442416+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.574005+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:01.429252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:28:41.284 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:28:43.632 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:28:43.633 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":385,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:28:42.925403+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:24.878552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:41.374270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:03.112443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.588601+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:42.664816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:28:05.069716+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.964655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:27:44.246105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:05.442416+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:42.751277+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:01.429252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:28:47.142 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:28:49.429 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:28:49.429 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":387,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:28:44.913657+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:24.878552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:41.374270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:03.112443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.588601+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:43.645524+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:28:05.069716+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.964655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:44.281058+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:05.442416+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:42.751277+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:01.429252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:28:53.020 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:28:55.256 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:28:55.256 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":387,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:28:44.913657+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:24.878552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:41.374270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:03.112443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.588601+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:43.645524+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:28:05.069716+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.964655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:44.281058+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:05.442416+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:42.751277+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:01.429252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:28:58.813 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:29:01.045 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:29:01.045 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":387,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:28:44.913657+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:24.878552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:41.374270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:03.112443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.588601+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:43.645524+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:28:05.069716+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.964655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:44.281058+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:05.442416+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:42.751277+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:01.429252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:29:04.578 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:29:06.825 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:29:06.826 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":390,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:29:05.955121+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:24.878552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:41.374270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:03.812152+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.588601+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:43.645524+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:29:05.229606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.964655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:44.281058+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:05.573511+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:42.751277+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:01.647723+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:29:10.347 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:29:12.580 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:29:12.581 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":391,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:29:09.925846+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:24.878552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:41.374270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:03.812152+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.588601+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:43.645524+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:29:05.229606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.964655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:44.281058+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:05.573511+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:42.751277+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:01.647723+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:29:16.112 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:29:18.337 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:29:18.337 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":391,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:29:09.925846+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:24.878552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:41.374270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:03.812152+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.588601+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:43.645524+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:29:05.229606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.964655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:44.281058+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:05.573511+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:42.751277+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:01.647723+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:29:21.894 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:29:24.164 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:29:24.164 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":392,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:29:24.095915+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:24.878552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:41.374270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:03.812152+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.045287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:43.645524+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:29:05.229606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:23.964655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:44.281058+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:05.573511+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:42.751277+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:01.647723+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:29:27.704 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:29:29.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:29:29.986 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":395,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:29:29.935699+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:25.861871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:41.374270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:03.812152+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.045287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:43.645524+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:29:05.229606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.299356+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:44.281058+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:05.573511+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:42.751277+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:01.647723+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:29:33.520 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:29:35.759 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:29:35.759 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":395,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:29:29.935699+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:25.861871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:41.374270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:03.812152+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.045287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:43.645524+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:29:05.229606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.299356+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:44.281058+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:05.573511+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:42.751277+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:01.647723+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:29:39.312 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:29:41.669 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:29:41.669 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":395,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:29:29.935699+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:25.861871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:41.374270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:03.812152+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.045287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:43.645524+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:29:05.229606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.299356+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:44.281058+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:05.573511+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:28:42.751277+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:01.647723+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:29:45.186 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:29:47.350 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:29:47.350 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":398,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:29:44.966984+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:25.861871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:42.251127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:03.812152+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.045287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.767879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:29:05.229606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.299356+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:44.349737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:05.573511+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.589103+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:01.647723+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:29:50.894 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:29:53.153 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:29:53.153 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":399,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:29:49.945900+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:25.861871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:42.251127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:03.812152+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.045287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.767879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:29:05.229606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.299356+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:44.349737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:05.573511+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.589103+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:01.647723+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:29:56.712 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:29:59.016 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:29:59.017 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":399,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:29:49.945900+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:25.861871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:42.251127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:03.812152+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.045287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.767879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:29:05.229606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.299356+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:44.349737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:05.573511+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.589103+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:01.647723+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:30:02.529 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:30:04.859 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:30:04.859 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":401,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:30:04.109694+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:25.861871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:42.251127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:04.058157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.045287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.767879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:29:05.229606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.299356+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:44.349737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:05.573511+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.589103+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:01.762704+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:30:08.406 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:30:10.686 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:30:10.687 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":403,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:30:09.955702+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:25.861871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:42.251127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:04.058157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.045287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.767879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:30:05.788628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.299356+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:44.349737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:05.652816+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.589103+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:01.762704+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:30:14.238 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:30:16.453 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:30:16.453 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":403,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:30:09.955702+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:25.861871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:42.251127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:04.058157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.045287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.767879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:30:05.788628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.299356+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:44.349737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:05.652816+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.589103+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:01.762704+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:30:19.984 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:30:22.211 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:30:22.211 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":403,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:30:09.955702+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:25.861871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:42.251127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:04.058157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.045287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.767879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:30:05.788628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:24.299356+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:44.349737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:05.652816+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.589103+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:01.762704+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:30:25.774 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:30:27.993 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:30:27.993 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":405,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:30:26.970571+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:26.825374+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:42.251127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:04.058157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:24.704071+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.767879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:30:05.788628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:24.449958+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:44.349737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:05.652816+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.589103+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:01.762704+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:30:31.541 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:30:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:30:33.829 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":405,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:30:26.970571+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:26.825374+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:42.251127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:04.058157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:24.704071+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.767879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:30:05.788628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:24.449958+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:44.349737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:05.652816+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.589103+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:01.762704+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:30:37.373 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:30:39.597 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:30:39.598 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":405,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:30:26.970571+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:26.825374+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:42.251127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:04.058157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:24.704071+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.767879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:30:05.788628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:24.449958+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:44.349737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:05.652816+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.589103+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:01.762704+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:30:43.142 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:30:45.344 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:30:45.344 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":407,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:30:44.459365+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:26.825374+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.119011+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:04.058157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:24.704071+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:43.767879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:30:05.788628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:24.449958+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:29:44.349737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:05.652816+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.944829+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:01.762704+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:30:48.868 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:30:51.124 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:30:51.124 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":409,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:30:49.974769+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:26.825374+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.119011+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:04.058157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:24.704071+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:44.619459+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:30:05.788628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:24.449958+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:45.140841+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:05.652816+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.944829+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:01.762704+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:30:54.682 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:30:56.925 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:30:56.926 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":409,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:30:49.974769+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:26.825374+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.119011+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:04.058157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:24.704071+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:44.619459+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:30:05.788628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:24.449958+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:45.140841+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:05.652816+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.944829+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:01.762704+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:31:00.454 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:31:02.760 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:31:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":409,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:30:49.974769+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:26.825374+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.119011+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:04.058157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:24.704071+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:44.619459+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:30:05.788628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:24.449958+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:45.140841+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:05.652816+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.944829+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:01.762704+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:31:06.272 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:31:08.534 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:31:08.534 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":412,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:31:06.988013+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:26.825374+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.119011+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:04.869013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:24.704071+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:44.619459+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:31:06.739109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:24.449958+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:45.140841+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:06.201867+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.944829+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:02.592369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:31:12.120 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:31:14.390 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:31:14.391 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":413,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:31:09.983931+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:26.825374+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.119011+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:04.869013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:24.704071+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:44.619459+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:31:06.739109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:24.449958+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:45.140841+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:06.201867+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.944829+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:02.592369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:31:17.921 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:31:20.158 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:31:20.159 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":413,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:31:09.983931+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:26.825374+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.119011+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:04.869013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:24.704071+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:44.619459+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:31:06.739109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:24.449958+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:45.140841+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:06.201867+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.944829+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:02.592369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:31:23.698 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:31:26.104 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:31:26.105 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":414,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:31:25.464074+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:26.825374+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.119011+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:04.869013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:24.931769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:44.619459+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:31:06.739109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:25.209093+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:45.140841+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:06.201867+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.944829+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:02.592369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:31:29.630 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:31:31.843 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:31:31.843 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":415,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:31:27.000213+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:26.909486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.119011+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:04.869013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:24.931769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:44.619459+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:31:06.739109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:25.209093+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:45.140841+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:06.201867+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.944829+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:02.592369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:31:35.359 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:31:37.636 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:31:37.637 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":415,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:31:27.000213+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:26.909486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.119011+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:04.869013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:24.931769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:44.619459+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:31:06.739109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:25.209093+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:45.140841+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:06.201867+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.944829+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:02.592369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:31:41.179 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:31:43.347 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:31:43.347 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":415,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:31:27.000213+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:26.909486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.119011+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:04.869013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:24.931769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:44.619459+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:31:06.739109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:25.209093+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:45.140841+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:06.201867+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:30:43.944829+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:02.592369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:31:46.865 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:31:49.027 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:31:49.027 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":418,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:31:46.012912+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:26.909486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:43.709489+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:04.869013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:24.931769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:45.194396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:31:06.739109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:25.209093+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:45.580833+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:06.201867+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:44.764467+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:02.592369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:31:52.604 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:31:54.869 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:31:54.869 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":419,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:31:50.004761+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:26.909486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:43.709489+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:04.869013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:24.931769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:45.194396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:31:06.739109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:25.209093+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:45.580833+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:06.201867+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:44.764467+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:02.592369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:31:58.415 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:32:00.629 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:32:00.630 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":419,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:31:50.004761+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:26.909486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:43.709489+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:04.869013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:24.931769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:45.194396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:31:06.739109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:25.209093+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:45.580833+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:06.201867+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:44.764467+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:02.592369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:32:04.140 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:32:06.513 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:32:06.513 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":422,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:32:06.025613+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:26.909486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:43.709489+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:05.464813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:24.931769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:45.194396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:31:06.739109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:25.209093+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:45.580833+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:06.201867+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:44.764467+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:02.748003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:32:10.067 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:32:12.331 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:32:12.331 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":425,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:32:10.016824+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:26.909486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:43.709489+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:05.464813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:24.931769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:45.194396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:32:07.606523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:25.209093+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:45.580833+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:06.371287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:44.764467+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:02.748003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:32:15.850 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:32:18.175 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:32:18.175 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":425,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:32:10.016824+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:26.909486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:43.709489+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:05.464813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:24.931769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:45.194396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:32:07.606523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:25.209093+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:45.580833+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:06.371287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:44.764467+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:02.748003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:32:21.699 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:32:23.957 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:32:23.957 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":425,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:32:10.016824+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:26.909486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:43.709489+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:05.464813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:24.931769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:45.194396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:32:07.606523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:25.209093+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:45.580833+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:06.371287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:44.764467+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:02.748003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:32:27.526 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:32:29.792 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:32:29.792 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":427,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:32:28.048389+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:27.156560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:43.709489+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:05.464813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:25.745822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:45.194396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:32:07.606523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:25.312173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:45.580833+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:06.371287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:44.764467+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:02.748003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:32:33.311 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:32:35.510 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:32:35.511 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":427,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:32:28.048389+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:27.156560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:43.709489+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:05.464813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:25.745822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:45.194396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:32:07.606523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:25.312173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:45.580833+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:06.371287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:44.764467+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:02.748003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:32:39.058 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:32:41.360 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:32:41.360 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":427,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:32:28.048389+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:27.156560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:43.709489+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:05.464813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:25.745822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:45.194396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:32:07.606523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:25.312173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:45.580833+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:06.371287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:31:44.764467+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:02.748003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:32:44.909 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:32:47.216 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:32:47.217 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":430,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:32:46.414721+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:27.156560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.350619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:05.464813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:25.745822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:46.169419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:32:07.606523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:25.312173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:45.604082+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:06.371287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.801263+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:02.748003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:32:50.800 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:32:52.982 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:32:53.137 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":431,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:32:50.036709+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:27.156560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.350619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:05.464813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:25.745822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:46.169419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:32:07.606523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:25.312173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:45.604082+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:06.371287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.801263+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:02.748003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:32:56.492 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:32:58.827 INFO:teuthology.orchestra.run.smithi037.stderr:2019-12-24T22:32:58.824+0000 7fafc3fff700 0 --2- 172.21.15.37:0/284260146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafc4065e40 0x7fafc4066270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-24T22:32:59.051 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:32:59.051 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":431,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:32:50.036709+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:27.156560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.350619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:05.464813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:25.745822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:46.169419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:32:07.606523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:25.312173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:45.604082+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:06.371287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.801263+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:02.748003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:33:02.556 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:33:04.825 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:33:04.826 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":432,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:33:03.485418+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:27.156560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.350619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:05.464813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:25.745822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:46.169419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:32:07.606523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:25.312173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:45.604082+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:06.371287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.801263+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:02.754212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:33:08.401 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:33:10.638 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:33:10.638 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":435,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:33:08.063760+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:27.156560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.350619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:05.482068+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:25.745822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:46.169419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:33:07.634932+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:25.312173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:45.604082+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:07.336856+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.801263+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:02.754212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:33:14.192 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:33:16.416 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:33:16.416 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":435,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:33:08.063760+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:27.156560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.350619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:05.482068+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:25.745822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:46.169419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:33:07.634932+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:25.312173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:45.604082+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:07.336856+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.801263+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:02.754212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:33:19.944 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:33:22.202 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:33:22.202 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":435,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:33:08.063760+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:27.156560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.350619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:05.482068+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:25.745822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:46.169419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:33:07.634932+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:25.312173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:45.604082+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:07.336856+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.801263+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:02.754212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:33:25.753 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:33:28.001 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:33:28.002 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":436,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:33:27.059168+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:27.156560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.350619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:05.482068+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.571743+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:46.169419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:33:07.634932+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.126438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:45.604082+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:07.336856+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.801263+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:02.754212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:33:31.562 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:33:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:33:33.831 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":437,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:33:28.068266+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:28.064016+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.350619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:05.482068+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.571743+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:46.169419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:33:07.634932+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.126438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:45.604082+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:07.336856+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.801263+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:02.754212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:33:37.338 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:33:39.641 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:33:39.641 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":437,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:33:28.068266+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:28.064016+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.350619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:05.482068+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.571743+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:46.169419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:33:07.634932+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.126438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:45.604082+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:07.336856+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.801263+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:02.754212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:33:43.192 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:33:45.479 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:33:45.479 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":439,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:33:45.061855+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:28.064016+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:44.360671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:05.482068+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.571743+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:46.169419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:33:07.634932+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.126438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:45.604082+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:07.336856+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:32:44.801263+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:02.754212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:33:49.028 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:33:51.167 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:33:51.168 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":441,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:33:47.435135+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:28.064016+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:44.360671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:05.482068+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.571743+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:46.899450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:33:07.634932+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.126438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:45.796670+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:07.336856+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:45.788085+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:02.754212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:33:54.730 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:33:56.972 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:33:56.973 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":441,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:33:47.435135+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:28.064016+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:44.360671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:05.482068+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.571743+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:46.899450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:33:07.634932+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.126438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:45.796670+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:07.336856+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:45.788085+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:02.754212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:34:00.484 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:34:02.730 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:34:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":441,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:33:47.435135+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:28.064016+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:44.360671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:05.482068+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.571743+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:46.899450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:33:07.634932+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.126438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:45.796670+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:07.336856+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:45.788085+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:02.754212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:34:06.287 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:34:08.421 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:34:08.421 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":445,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:34:08.229165+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:28.064016+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:44.360671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:05.836037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.571743+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:46.899450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:33:07.634932+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.126438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:45.796670+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:08.175480+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:45.788085+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:03.281494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:34:11.964 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:34:14.201 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:34:14.202 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":447,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:34:10.075351+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:28.064016+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:44.360671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:05.836037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.571743+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:46.899450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:34:08.464107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.126438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:45.796670+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:08.175480+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:45.788085+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:03.281494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:34:17.756 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:34:20.002 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:34:20.003 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":447,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:34:10.075351+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:28.064016+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:44.360671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:05.836037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.571743+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:46.899450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:34:08.464107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.126438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:45.796670+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:08.175480+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:45.788085+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:03.281494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:34:23.512 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:34:25.769 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:34:25.770 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":447,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:34:10.075351+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:28.064016+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:44.360671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:05.836037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.571743+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:46.899450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:34:08.464107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:26.126438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:45.796670+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:08.175480+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:45.788085+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:03.281494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:34:29.312 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:34:31.493 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:34:31.493 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":451,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:34:30.086423+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:29.057091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:44.360671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:05.836037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:27.308926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:46.899450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:34:08.464107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:26.263442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:45.796670+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:08.175480+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:45.788085+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:03.281494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:34:35.031 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:34:37.332 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:34:37.332 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":451,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:34:30.086423+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:29.057091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:44.360671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:05.836037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:27.308926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:46.899450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:34:08.464107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:26.263442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:45.796670+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:08.175480+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:45.788085+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:03.281494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:34:40.855 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:34:43.113 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:34:43.113 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":451,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:34:30.086423+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:29.057091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:44.360671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:05.836037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:27.308926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:46.899450+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:34:08.464107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:26.263442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:45.796670+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:08.175480+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:33:45.788085+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:03.281494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:34:46.623 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:34:48.850 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:34:48.850 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":454,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:34:47.524098+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:29.057091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:44.861566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:05.836037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:27.308926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:47.113784+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:34:08.464107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:26.263442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:45.810986+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:08.175480+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:46.655145+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:03.281494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:34:52.405 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:34:54.629 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:34:54.629 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":455,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:34:50.095824+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:29.057091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:44.861566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:05.836037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:27.308926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:47.113784+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:34:08.464107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:26.263442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:45.810986+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:08.175480+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:46.655145+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:03.281494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:34:58.139 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:35:00.495 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:35:00.496 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":455,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:34:50.095824+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:29.057091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:44.861566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:05.836037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:27.308926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:47.113784+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:34:08.464107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:26.263442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:45.810986+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:08.175480+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:46.655145+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:03.281494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:35:04.011 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:35:06.287 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:35:06.287 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":457,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:35:05.106236+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:29.057091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:44.861566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:05.836037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:27.308926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:47.113784+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:34:08.464107+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:26.263442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:45.810986+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:08.175480+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:46.655145+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:03.521190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:35:09.864 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:35:12.138 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:35:12.138 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":460,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:35:10.130602+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:29.057091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:44.861566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:06.700939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:27.308926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:47.113784+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:35:09.325279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:26.263442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:45.810986+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:08.359300+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:46.655145+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:03.521190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:35:15.674 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:35:17.968 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:35:17.968 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":461,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:35:15.112122+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:29.057091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:44.861566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:06.700939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:27.308926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:47.113784+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:35:09.325279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:26.263442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:45.810986+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:08.359300+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:46.655145+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:03.521190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:35:21.504 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:35:23.741 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:35:23.741 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":461,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:35:15.112122+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:29.057091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:44.861566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:06.700939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:27.308926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:47.113784+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:35:09.325279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:26.263442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:45.810986+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:08.359300+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:46.655145+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:03.521190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:35:27.312 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:35:29.550 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:35:29.551 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":463,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:35:29.128838+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:29.087271+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:44.861566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:06.700939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.323858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:47.113784+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:35:09.325279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.212244+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:45.810986+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:08.359300+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:46.655145+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:03.521190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:35:33.099 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:35:35.392 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:35:35.392 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":463,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:35:29.128838+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:29.087271+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:44.861566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:06.700939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.323858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:47.113784+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:35:09.325279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.212244+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:45.810986+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:08.359300+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:46.655145+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:03.521190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:35:38.924 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:35:41.135 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:35:41.135 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":463,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:35:29.128838+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:29.087271+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:44.861566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:06.700939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.323858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:47.113784+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:35:09.325279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.212244+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:45.810986+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:08.359300+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:46.655145+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:03.521190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:35:44.691 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:35:46.907 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:35:46.908 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":464,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:35:46.139287+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:29.087271+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.768430+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:06.700939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.323858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:47.113784+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:35:09.325279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.212244+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.984359+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:08.359300+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:34:46.655145+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:03.521190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:35:50.483 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:35:52.673 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:35:52.674 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":465,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:35:48.149093+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:29.087271+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.768430+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:06.700939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.323858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:47.908060+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:35:09.325279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.212244+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.984359+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:08.359300+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:47.511015+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:03.521190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:35:56.181 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:35:58.470 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:35:58.470 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":465,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:35:48.149093+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:29.087271+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.768430+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:06.700939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.323858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:47.908060+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:35:09.325279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.212244+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.984359+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:08.359300+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:47.511015+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:03.521190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:36:01.998 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:36:04.355 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:36:04.355 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":466,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:36:03.939383+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:29.087271+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.768430+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:06.700939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.323858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:47.908060+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:35:09.325279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.212244+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.984359+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:08.359300+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:47.511015+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:03.888294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:36:07.915 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:36:10.181 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:36:10.182 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":469,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:36:08.963747+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:29.087271+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.768430+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:06.823460+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.323858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:47.908060+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:35:09.325279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.212244+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.984359+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:08.427287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:47.511015+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:03.888294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:36:13.690 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:36:15.992 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:36:15.992 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":471,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:36:15.142007+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:29.087271+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.768430+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:06.823460+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.323858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:47.908060+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:36:10.102942+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.212244+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.984359+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:08.427287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:47.511015+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:03.888294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:36:19.502 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:36:21.764 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:36:21.765 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":471,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:36:15.142007+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:29.087271+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.768430+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:06.823460+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.323858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:47.908060+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:36:10.102942+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.212244+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.984359+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:08.427287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:47.511015+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:03.888294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:36:25.267 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:36:27.466 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:36:27.466 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":471,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:36:15.142007+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:29.087271+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.768430+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:06.823460+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.323858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:47.908060+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:36:10.102942+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:27.212244+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.984359+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:08.427287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:47.511015+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:03.888294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:36:31.007 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:36:33.243 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:36:33.244 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":473,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:36:29.552516+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:29.109925+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.768430+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:06.823460+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:27.495680+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:47.908060+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:36:10.102942+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:27.340218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.984359+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:08.427287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:47.511015+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:03.888294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:36:36.784 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:36:39.016 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:36:39.016 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":473,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:36:29.552516+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:29.109925+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.768430+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:06.823460+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:27.495680+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:47.908060+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:36:10.102942+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:27.340218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.984359+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:08.427287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:47.511015+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:03.888294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:36:42.549 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:36:44.783 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:36:44.784 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":473,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:36:29.552516+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:29.109925+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.768430+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:06.823460+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:27.495680+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:47.908060+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:36:10.102942+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:27.340218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:45.984359+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:08.427287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:35:47.511015+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:03.888294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:36:48.360 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:36:50.659 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:36:50.659 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":477,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:36:50.160974+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:29.109925+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:46.035722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:06.823460+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:27.495680+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.655241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:36:10.102942+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:27.340218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:46.097748+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:08.427287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.168567+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:03.888294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:36:54.211 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:36:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:36:56.370 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":477,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:36:50.160974+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:29.109925+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:46.035722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:06.823460+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:27.495680+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.655241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:36:10.102942+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:27.340218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:46.097748+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:08.427287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.168567+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:03.888294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:36:59.909 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:37:02.184 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:37:02.184 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":477,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:36:50.160974+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:29.109925+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:46.035722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:06.823460+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:27.495680+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.655241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:36:10.102942+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:27.340218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:46.097748+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:08.427287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.168567+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:03.888294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:37:05.751 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:37:08.055 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:37:08.055 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":480,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:37:07.539671+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:29.109925+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:46.035722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:07.111212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:27.495680+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.655241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:36:10.102942+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:27.340218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:46.097748+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:08.427287+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.168567+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:04.070185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:37:11.585 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:37:13.860 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:37:13.860 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":482,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:37:11.175987+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:29.109925+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:46.035722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:07.111212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:27.495680+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.655241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:37:10.406218+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:27.340218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:46.097748+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:09.355524+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.168567+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:04.070185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:37:17.421 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:37:19.632 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:37:19.632 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":483,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:37:15.174648+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:29.109925+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:46.035722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:07.111212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:27.495680+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.655241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:37:10.406218+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:27.340218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:46.097748+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:09.355524+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.168567+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:04.070185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:37:23.155 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:37:25.462 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:37:25.462 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":483,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:37:15.174648+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:29.109925+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:46.035722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:07.111212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:27.495680+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.655241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:37:10.406218+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:27.340218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:46.097748+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:09.355524+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.168567+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:04.070185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:37:29.006 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:37:31.264 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:37:31.265 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":487,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:37:30.181910+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:29.251268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:46.035722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:07.111212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:27.879801+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.655241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:37:10.406218+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:27.712435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:46.097748+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:09.355524+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.168567+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:04.070185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:37:34.796 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:37:37.070 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:37:37.071 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":487,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:37:30.181910+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:29.251268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:46.035722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:07.111212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:27.879801+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.655241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:37:10.406218+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:27.712435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:46.097748+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:09.355524+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.168567+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:04.070185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:37:40.564 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:37:42.751 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:37:42.751 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":487,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:37:30.181910+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:29.251268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:46.035722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:07.111212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:27.879801+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.655241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:37:10.406218+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:27.712435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:46.097748+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:09.355524+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.168567+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:04.070185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:37:46.290 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:37:48.801 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:37:48.802 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":489,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:37:47.566181+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:29.251268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.772368+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:07.111212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:27.879801+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.655241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:37:10.406218+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:27.712435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.496584+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:09.355524+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:36:48.168567+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:04.070185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:37:52.356 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:37:54.639 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:37:54.639 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":491,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:37:50.190276+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:29.251268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.772368+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:07.111212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:27.879801+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:49.392086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:37:10.406218+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:27.712435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.496584+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:09.355524+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:49.099765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:04.070185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:37:58.157 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:38:00.405 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:38:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":491,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:37:50.190276+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:29.251268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.772368+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:07.111212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:27.879801+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:49.392086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:37:10.406218+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:27.712435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.496584+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:09.355524+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:49.099765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:04.070185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:38:03.948 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:38:06.284 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:38:06.285 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":493,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:38:05.199083+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:29.251268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.772368+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:07.111212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:27.879801+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:49.392086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:37:10.406218+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:27.712435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.496584+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:09.355524+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:49.099765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:04.257423+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:38:09.809 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:38:12.137 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:38:12.137 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":496,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:38:11.220990+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:29.251268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.772368+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:07.948930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:27.879801+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:49.392086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:38:11.203011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:27.712435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.496584+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:09.428302+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:49.099765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:04.257423+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:38:15.671 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:38:17.851 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:38:17.851 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":497,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:38:15.205170+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:29.251268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.772368+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:07.948930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:27.879801+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:49.392086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:38:11.203011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:27.712435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.496584+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:09.428302+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:49.099765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:04.257423+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:38:21.410 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:38:23.706 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:38:23.707 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":497,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:38:15.205170+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:29.251268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.772368+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:07.948930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:27.879801+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:49.392086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:38:11.203011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:27.712435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.496584+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:09.428302+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:49.099765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:04.257423+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:38:27.261 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:38:29.511 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:38:29.512 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":499,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:38:28.892638+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:29.251268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.772368+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:07.948930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.911795+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:49.392086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:38:11.203011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.839627+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.496584+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:09.428302+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:49.099765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:04.257423+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:38:33.048 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:38:35.362 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:38:35.363 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":501,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:38:30.212731+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:29.305305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.772368+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:07.948930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.911795+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:49.392086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:38:11.203011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.839627+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.496584+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:09.428302+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:49.099765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:04.257423+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:38:38.944 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:38:41.311 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:38:41.311 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":501,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:38:30.212731+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:29.305305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.772368+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:07.948930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.911795+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:49.392086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:38:11.203011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.839627+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.496584+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:09.428302+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:49.099765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:04.257423+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:38:44.820 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:38:47.117 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:38:47.118 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":501,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:38:30.212731+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:29.305305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.772368+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:07.948930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.911795+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:49.392086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:38:11.203011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.839627+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:46.496584+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:09.428302+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:37:49.099765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:04.257423+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:38:50.669 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:38:52.958 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:38:52.959 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":505,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:38:50.223449+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:29.305305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:47.677162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:07.948930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.911795+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.497382+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:38:11.203011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.839627+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:47.128382+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:09.428302+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.325872+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:04.257423+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:38:56.531 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:38:58.802 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:38:58.802 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":505,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:38:50.223449+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:29.305305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:47.677162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:07.948930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.911795+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.497382+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:38:11.203011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.839627+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:47.128382+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:09.428302+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.325872+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:04.257423+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:39:02.306 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:39:04.549 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:39:04.549 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":506,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:39:04.446130+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:29.305305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:47.677162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:07.948930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.911795+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.497382+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:38:11.203011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.839627+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:47.128382+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:09.428302+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.325872+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:04.399113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:39:08.071 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:39:10.356 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:39:10.356 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":509,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:39:10.207589+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:29.305305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:47.677162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:08.145461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.911795+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.497382+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:38:11.203011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.839627+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:47.128382+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:09.607847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.325872+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:04.399113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:39:13.955 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:39:16.140 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:39:16.140 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":511,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:39:15.236219+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:29.305305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:47.677162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:08.145461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.911795+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.497382+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:39:12.136736+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.839627+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:47.128382+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:09.607847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.325872+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:04.399113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:39:19.695 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:39:21.880 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:39:21.881 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":511,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:39:15.236219+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:29.305305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:47.677162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:08.145461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.911795+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.497382+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:39:12.136736+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.839627+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:47.128382+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:09.607847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.325872+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:04.399113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:39:25.399 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:39:27.693 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:39:27.694 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":511,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:39:15.236219+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:29.305305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:47.677162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:08.145461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.911795+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.497382+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:39:12.136736+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:27.839627+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:47.128382+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:09.607847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.325872+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:04.399113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:39:31.230 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:39:33.540 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:39:33.540 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":514,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:39:31.253801+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:30.268339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:47.677162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:08.145461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:28.092779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.497382+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:39:12.136736+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:28.693774+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:47.128382+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:09.607847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.325872+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:04.399113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:39:37.158 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:39:39.514 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:39:39.515 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":515,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:39:35.246702+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:30.268339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:47.677162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:08.145461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:28.092779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.497382+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:39:12.136736+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:28.693774+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:47.128382+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:09.607847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.325872+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:04.399113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:39:43.061 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:39:45.298 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:39:45.298 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":515,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:39:35.246702+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:30.268339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:47.677162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:08.145461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:28.092779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.497382+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:39:12.136736+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:28.693774+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:47.128382+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:09.607847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.325872+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:04.399113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:39:48.855 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:39:51.130 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:39:51.131 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":518,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:39:50.284696+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:30.268339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:48.543337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:08.145461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:28.092779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:38:49.497382+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:39:12.136736+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:28.693774+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:47.345435+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:09.607847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.228252+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:04.399113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:39:54.742 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:39:56.983 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:39:56.984 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":519,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:39:51.293512+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:30.268339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:48.543337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:08.145461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:28.092779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.371051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:39:12.136736+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:28.693774+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:47.345435+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:09.607847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.228252+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:04.399113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:40:00.557 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:40:02.848 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:40:02.848 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":519,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:39:51.293512+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:30.268339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:48.543337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:08.145461+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:28.092779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.371051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:39:12.136736+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:28.693774+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:47.345435+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:09.607847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.228252+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:04.399113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:40:06.424 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:40:08.688 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:40:08.689 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":521,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:40:08.274286+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:30.268339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:48.543337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:08.182163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:28.092779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.371051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:39:12.136736+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:28.693774+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:47.345435+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:09.607847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.228252+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:05.339049+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:40:12.273 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:40:14.598 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:40:14.599 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":523,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:40:13.579093+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:30.268339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:48.543337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:08.182163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:28.092779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.371051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:40:12.759870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:28.693774+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:47.345435+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:09.690255+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.228252+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:05.339049+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:40:18.138 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:40:20.354 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:40:20.355 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":523,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:40:13.579093+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:30.268339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:48.543337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:08.182163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:28.092779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.371051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:40:12.759870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:28.693774+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:47.345435+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:09.690255+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.228252+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:05.339049+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:40:23.913 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:40:26.157 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:40:26.158 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":523,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:40:13.579093+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:30.268339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:48.543337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:08.182163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:28.092779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.371051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:40:12.759870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:28.693774+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:47.345435+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:09.690255+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.228252+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:05.339049+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:40:29.715 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:40:32.027 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:40:32.028 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":526,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:40:31.274884+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:30.834545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:48.543337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:08.182163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:28.115209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.371051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:40:12.759870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:28.823776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:47.345435+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:09.690255+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.228252+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:05.339049+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:40:35.584 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:40:37.965 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:40:37.966 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":527,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:40:35.273062+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:30.834545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:48.543337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:08.182163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:28.115209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.371051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:40:12.759870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:28.823776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:47.345435+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:09.690255+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.228252+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:05.339049+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:40:41.513 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:40:43.830 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:40:43.830 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":527,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:40:35.273062+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:30.834545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:48.543337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:08.182163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:28.115209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.371051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:40:12.759870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:28.823776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:47.345435+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:09.690255+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.228252+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:05.339049+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:40:47.407 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:40:49.686 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:40:49.686 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":529,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:40:49.303485+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:30.834545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.846438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:08.182163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:28.115209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.371051+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:40:12.759870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:28.823776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.251730+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:09.690255+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:39:50.228252+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:05.339049+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:40:53.211 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:40:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:40:55.515 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":531,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:40:55.282143+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:30.834545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.846438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:08.182163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:28.115209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:51.251534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:40:12.759870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:28.823776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.251730+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:09.690255+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:50.335672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:05.339049+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:40:59.056 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:41:01.316 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:41:01.317 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":531,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:40:55.282143+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:30.834545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.846438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:08.182163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:28.115209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:51.251534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:40:12.759870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:28.823776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.251730+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:09.690255+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:50.335672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:05.339049+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:41:04.873 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:41:07.066 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:41:07.067 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":532,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:41:06.296500+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:30.834545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.846438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:08.182163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:28.115209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:51.251534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:40:12.759870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:28.823776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.251730+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:09.690255+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:50.335672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:05.488721+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:41:10.612 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:41:12.952 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:41:12.952 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":534,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:41:10.608528+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:30.834545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.846438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:08.930728+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:28.115209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:51.251534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:40:12.759870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:28.823776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.251730+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:09.866507+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:50.335672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:05.488721+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:41:16.481 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:41:18.712 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:41:18.713 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":535,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:41:13.622614+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:30.834545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.846438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:08.930728+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:28.115209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:51.251534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:41:13.225191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:28.823776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.251730+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:09.866507+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:50.335672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:05.488721+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:41:22.246 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:41:24.531 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:41:24.531 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":535,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:41:13.622614+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:30.834545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.846438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:08.930728+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:28.115209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:51.251534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:41:13.225191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:28.823776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.251730+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:09.866507+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:50.335672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:05.488721+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:41:28.103 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:41:30.361 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:41:30.361 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":537,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:41:30.299006+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:30.834545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.846438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:08.930728+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:28.430360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:51.251534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:41:13.225191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:29.549946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.251730+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:09.866507+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:50.335672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:05.488721+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:41:33.936 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:41:36.192 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:41:36.193 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":539,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:41:35.302173+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:30.927193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.846438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:08.930728+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:28.430360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:51.251534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:41:13.225191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:29.549946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.251730+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:09.866507+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:50.335672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:05.488721+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:41:39.708 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:41:42.035 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:41:42.036 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":539,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:41:35.302173+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:30.927193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.846438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:08.930728+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:28.430360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:51.251534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:41:13.225191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:29.549946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.251730+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:09.866507+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:50.335672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:05.488721+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:41:45.596 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:41:47.905 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:41:47.906 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":539,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:41:35.302173+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:30.927193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.846438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:08.930728+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:28.430360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:51.251534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:41:13.225191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:29.549946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:48.251730+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:09.866507+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:40:50.335672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:05.488721+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:41:51.456 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:41:53.647 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:41:53.648 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":543,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:41:52.328402+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:30.927193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:49.686972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:08.930728+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:28.430360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:51.540189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:41:13.225191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:29.549946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:48.280637+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:09.866507+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:50.664004+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:05.488721+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:41:57.126 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:41:59.431 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:41:59.432 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":543,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:41:52.328402+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:30.927193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:49.686972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:08.930728+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:28.430360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:51.540189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:41:13.225191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:29.549946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:48.280637+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:09.866507+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:50.664004+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:05.488721+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:42:03.014 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:42:05.261 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:42:05.262 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":543,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:41:52.328402+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:30.927193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:49.686972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:08.930728+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:28.430360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:51.540189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:41:13.225191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:29.549946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:48.280637+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:09.866507+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:50.664004+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:05.488721+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:42:08.780 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:42:11.071 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:42:11.072 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":546,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:42:10.614639+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:30.927193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:49.686972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.140668+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:28.430360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:51.540189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:41:13.225191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:29.549946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:48.280637+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.920055+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:50.664004+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:05.526356+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:42:14.623 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:42:16.932 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:42:16.932 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":547,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:42:14.167463+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:30.927193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:49.686972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.140668+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:28.430360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:51.540189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:42:14.118693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:29.549946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:48.280637+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.920055+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:50.664004+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:05.526356+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:42:20.473 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:42:22.722 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:42:22.722 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":547,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:42:14.167463+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:30.927193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:49.686972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.140668+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:28.430360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:51.540189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:42:14.118693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:29.549946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:48.280637+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.920055+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:50.664004+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:05.526356+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:42:26.259 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:42:28.527 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:42:28.528 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":547,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:42:14.167463+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:30.927193+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:49.686972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.140668+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:28.430360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:51.540189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:42:14.118693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:29.549946+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:48.280637+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.920055+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:50.664004+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:05.526356+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:42:32.083 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:42:34.375 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:42:34.376 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":550,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:42:31.625612+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:31.192162+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:49.686972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.140668+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:29.186147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:51.540189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:42:14.118693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:29.589417+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:48.280637+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.920055+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:50.664004+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:05.526356+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:42:37.968 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:42:40.200 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:42:40.201 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":551,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:42:35.331345+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:31.192162+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:49.686972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.140668+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:29.186147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:51.540189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:42:14.118693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:29.589417+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:48.280637+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.920055+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:50.664004+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:05.526356+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:42:43.746 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:42:46.022 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:42:46.023 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":551,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:42:35.331345+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:31.192162+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:49.686972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.140668+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:29.186147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:51.540189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:42:14.118693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:29.589417+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:48.280637+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.920055+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:50.664004+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:05.526356+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:42:49.598 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:42:51.877 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:42:51.877 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":553,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:42:50.340321+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:31.192162+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:49.760746+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.140668+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:29.186147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:51.540189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:42:14.118693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:29.589417+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:48.609758+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.920055+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:41:50.664004+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:05.526356+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:42:55.448 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:42:57.684 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:42:57.685 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":555,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:42:53.360508+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:31.192162+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:49.760746+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.140668+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:29.186147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:52.477582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:42:14.118693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:29.589417+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:48.609758+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.920055+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:51.390429+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:05.526356+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:43:01.231 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:43:03.572 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:43:03.572 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":555,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:42:53.360508+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:31.192162+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:49.760746+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.140668+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:29.186147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:52.477582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:42:14.118693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:29.589417+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:48.609758+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.920055+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:51.390429+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:05.526356+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:43:07.487 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:43:09.913 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:43:09.914 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":557,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:43:09.640341+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:31.192162+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:49.760746+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:09.492428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:29.186147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:52.477582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:42:14.118693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:29.589417+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:48.609758+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:09.920055+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:51.390429+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:05.724264+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:43:13.620 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:43:25.681 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:43:25.681 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":558,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:43:10.643471+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:31.192162+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:49.760746+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:09.492428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:29.186147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:52.477582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:42:14.118693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:29.589417+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:48.609758+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:10.104096+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:51.390429+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:05.724264+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:43:29.482 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:43:31.783 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:43:31.783 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":561,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:43:30.353604+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:31.192162+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:49.760746+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:09.492428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:30.183753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:52.477582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:43:14.904109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:30.250396+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:48.609758+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:10.104096+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:51.390429+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:05.724264+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:43:35.440 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:43:37.673 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:43:37.673 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":563,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:43:35.355378+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:31.473725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:49.760746+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:09.492428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:30.183753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:52.477582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:43:14.904109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:30.250396+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:48.609758+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:10.104096+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:51.390429+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:05.724264+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:43:41.335 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:43:43.575 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:43:43.575 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":563,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:43:35.355378+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:31.473725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:49.760746+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:09.492428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:30.183753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:52.477582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:43:14.904109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:30.250396+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:48.609758+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:10.104096+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:51.390429+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:05.724264+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:43:47.215 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:43:49.463 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:43:49.463 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":563,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:43:35.355378+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:31.473725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:49.760746+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:09.492428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:30.183753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:52.477582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:43:14.904109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:30.250396+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:48.609758+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:10.104096+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:42:51.390429+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:05.724264+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:43:53.040 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:43:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:43:55.470 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":569,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:43:55.363895+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:31.473725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:50.643395+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:09.492428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:30.183753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:52.795841+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:43:14.904109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:30.250396+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:49.465148+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:10.104096+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:51.521758+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:05.724264+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:43:59.066 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:44:01.474 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:44:01.475 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":569,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:43:55.363895+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:31.473725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:50.643395+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:09.492428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:30.183753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:52.795841+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:43:14.904109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:30.250396+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:49.465148+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:10.104096+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:51.521758+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:05.724264+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:44:05.060 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:44:07.338 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:44:07.339 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":570,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:44:06.636664+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:31.473725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:50.643395+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:09.492428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:30.183753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:52.795841+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:43:14.904109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:30.250396+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:49.465148+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:10.104096+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:51.521758+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:06.514713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:44:10.850 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:44:13.108 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:44:13.108 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":572,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:44:11.374945+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:31.473725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:50.643395+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.042901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:30.183753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:52.795841+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:43:14.904109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:30.250396+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:49.465148+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.966337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:51.521758+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:06.514713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:44:16.668 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:44:18.892 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:44:18.893 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":573,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:44:15.373405+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:31.473725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:50.643395+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.042901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:30.183753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:52.795841+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:44:15.089934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:30.250396+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:49.465148+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.966337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:51.521758+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:06.514713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:44:22.410 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:44:24.764 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:44:24.765 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":573,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:44:15.373405+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:31.473725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:50.643395+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.042901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:30.183753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:52.795841+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:44:15.089934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:30.250396+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:49.465148+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.966337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:51.521758+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:06.514713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:44:28.315 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:44:30.586 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:44:30.587 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":574,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:44:30.429745+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:31.473725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:50.643395+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.042901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.384931+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:52.795841+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:44:15.089934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.380505+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:49.465148+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.966337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:51.521758+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:06.514713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:44:34.136 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:44:36.478 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:44:36.478 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":575,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:44:32.441248+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:31.606094+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:50.643395+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.042901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.384931+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:52.795841+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:44:15.089934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.380505+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:49.465148+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.966337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:51.521758+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:06.514713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:44:40.010 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:44:42.354 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:44:42.355 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":575,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:44:32.441248+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:31.606094+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:50.643395+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.042901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.384931+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:52.795841+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:44:15.089934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.380505+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:49.465148+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.966337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:51.521758+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:06.514713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:44:45.869 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:44:48.157 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:44:48.158 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":575,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:44:32.441248+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:31.606094+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:50.643395+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.042901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.384931+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:52.795841+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:44:15.089934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.380505+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:49.465148+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.966337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:43:51.521758+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:06.514713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:44:51.685 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:44:53.912 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:44:53.912 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":578,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:44:53.414554+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:31.606094+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:51.536105+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.042901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.384931+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.876298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:44:15.089934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.380505+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:50.475399+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.966337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.293748+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:06.514713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:44:57.433 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:44:59.744 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:44:59.745 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":579,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:44:55.393860+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:31.606094+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:51.536105+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.042901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.384931+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.876298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:44:15.089934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.380505+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:50.475399+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.966337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.293748+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:06.514713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:45:03.282 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:45:05.537 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:45:05.537 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":579,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:44:55.393860+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:31.606094+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:51.536105+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.042901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.384931+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.876298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:44:15.089934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.380505+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:50.475399+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.966337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.293748+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:06.514713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:45:09.042 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:45:11.321 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:45:11.322 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":581,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:45:10.401375+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:31.606094+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:51.536105+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.042901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.384931+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.876298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:44:15.089934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.380505+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:50.475399+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:10.966337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.293748+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:07.459492+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:45:14.817 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:45:16.989 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:45:16.989 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":583,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:45:15.405649+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:31.606094+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:51.536105+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:10.828710+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.384931+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.876298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:45:15.287424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.380505+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:50.475399+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:11.147682+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.293748+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:07.459492+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:45:20.503 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:45:22.761 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:45:22.761 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":583,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:45:15.405649+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:31.606094+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:51.536105+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:10.828710+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.384931+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.876298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:45:15.287424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.380505+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:50.475399+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:11.147682+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.293748+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:07.459492+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:45:26.274 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:45:28.517 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:45:28.518 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":583,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:45:15.405649+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:31.606094+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:51.536105+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:10.828710+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.384931+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.876298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:45:15.287424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:30.380505+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:50.475399+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:11.147682+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.293748+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:07.459492+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:45:31.989 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:45:34.144 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:45:34.144 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":585,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:45:33.433147+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:32.485212+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:51.536105+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:10.828710+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.154532+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.876298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:45:15.287424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.330515+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:50.475399+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:11.147682+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.293748+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:07.459492+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:45:37.698 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:45:39.902 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:45:39.902 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":585,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:45:33.433147+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:32.485212+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:51.536105+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:10.828710+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.154532+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.876298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:45:15.287424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.330515+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:50.475399+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:11.147682+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.293748+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:07.459492+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:45:43.380 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:45:45.663 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:45:45.663 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":585,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:45:33.433147+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:32.485212+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:51.536105+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:10.828710+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.154532+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.876298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:45:15.287424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.330515+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:50.475399+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:11.147682+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.293748+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:07.459492+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:45:49.198 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:45:51.476 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:45:51.476 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":586,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:45:51.427901+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:32.485212+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:51.536105+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:10.828710+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.154532+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.876298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:45:15.287424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.330515+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:51.404251+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:11.147682+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:44:52.293748+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:07.459492+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:45:55.005 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:45:57.309 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:45:57.309 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":589,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:45:55.427122+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:32.485212+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:52.526474+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:10.828710+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.154532+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:53.467069+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:45:15.287424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.330515+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:51.404251+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:11.147682+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:53.114118+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:07.459492+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:46:00.813 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:46:03.089 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:46:03.089 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":589,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:45:55.427122+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:32.485212+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:52.526474+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:10.828710+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.154532+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:53.467069+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:45:15.287424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.330515+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:51.404251+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:11.147682+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:53.114118+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:07.459492+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:46:06.603 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:46:08.891 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:46:08.892 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":590,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:46:07.818224+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:32.485212+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:52.526474+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:10.828710+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.154532+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:53.467069+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:45:15.287424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.330515+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:51.404251+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:11.147682+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:53.114118+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:07.769823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:46:12.394 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:46:14.601 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:46:14.602 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":592,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:46:12.446975+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:32.485212+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:52.526474+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.739437+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.154532+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:53.467069+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:45:15.287424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.330515+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:51.404251+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.535323+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:53.114118+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:07.769823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:46:18.144 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:46:20.468 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:46:20.469 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":595,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:46:20.439609+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:32.485212+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:52.526474+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.739437+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.154532+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:53.467069+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:46:15.524728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.330515+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:51.404251+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.535323+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:53.114118+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:07.769823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:46:23.945 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:46:26.160 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:46:26.161 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":595,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:46:20.439609+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:32.485212+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:52.526474+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.739437+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.154532+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:53.467069+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:46:15.524728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.330515+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:51.404251+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.535323+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:53.114118+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:07.769823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:46:29.637 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:46:31.945 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:46:31.945 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":595,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:46:20.439609+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:32.485212+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:52.526474+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.739437+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.154532+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:53.467069+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:46:15.524728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:31.330515+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:51.404251+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.535323+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:53.114118+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:07.769823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:46:35.480 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:46:37.742 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:46:37.743 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":597,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:46:33.461989+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:33.290169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:52.526474+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.739437+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:31.571256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:53.467069+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:46:15.524728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:31.629426+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:51.404251+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.535323+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:53.114118+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:07.769823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:46:41.203 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:46:43.609 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:46:43.609 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":597,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:46:33.461989+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:33.290169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:52.526474+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.739437+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:31.571256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:53.467069+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:46:15.524728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:31.629426+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:51.404251+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.535323+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:53.114118+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:07.769823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:46:47.151 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:46:49.405 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:46:49.406 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":597,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:46:33.461989+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:33.290169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:52.526474+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.739437+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:31.571256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:53.467069+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:46:15.524728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:31.629426+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:51.404251+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.535323+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:45:53.114118+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:07.769823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:46:52.934 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:46:55.158 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:46:55.158 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":600,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:46:54.472400+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:33.290169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:52.583843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.739437+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:31.571256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.604077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:46:15.524728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:31.629426+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:51.684371+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.535323+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.327154+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:07.769823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:46:58.692 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:47:00.975 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:47:00.976 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":601,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:46:55.457928+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:33.290169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:52.583843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.739437+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:31.571256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.604077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:46:15.524728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:31.629426+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:51.684371+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.535323+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.327154+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:07.769823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:47:04.509 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:47:06.818 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:47:06.818 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":601,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:46:55.457928+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:33.290169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:52.583843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.739437+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:31.571256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.604077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:46:15.524728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:31.629426+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:51.684371+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.535323+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.327154+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:07.769823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:47:10.328 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:47:12.581 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:47:12.581 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":604,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:47:12.480075+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:33.290169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:52.583843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:11.739437+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:31.571256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.604077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:46:15.524728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:31.629426+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:51.684371+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:11.590555+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.327154+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:07.800589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:47:16.118 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:47:18.362 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:47:18.362 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":606,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:47:16.562086+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:33.290169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:52.583843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:12.764364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:31.571256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.604077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:47:16.511873+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:31.629426+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:51.684371+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:11.590555+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.327154+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:07.800589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:47:21.870 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:47:24.117 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:47:24.117 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":607,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:47:20.471411+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:33.290169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:52.583843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:12.764364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:31.571256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.604077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:47:16.511873+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:31.629426+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:51.684371+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:11.590555+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.327154+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:07.800589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:47:27.660 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:47:29.869 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:47:29.870 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":607,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:47:20.471411+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:33.290169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:52.583843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:12.764364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:31.571256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.604077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:47:16.511873+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:31.629426+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:51.684371+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:11.590555+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.327154+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:07.800589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:47:33.400 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:47:35.684 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:47:35.685 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":609,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:47:33.485670+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:33.422558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:52.583843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:12.764364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:32.277747+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.604077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:47:16.511873+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:31.760294+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:51.684371+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:11.590555+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.327154+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:07.800589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:47:39.210 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:47:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:47:41.430 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":609,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:47:33.485670+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:33.422558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:52.583843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:12.764364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:32.277747+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.604077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:47:16.511873+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:31.760294+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:51.684371+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:11.590555+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.327154+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:07.800589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:47:44.951 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:47:47.286 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:47:47.286 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":609,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:47:33.485670+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:33.422558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:52.583843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:12.764364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:32.277747+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.604077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:47:16.511873+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:31.760294+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:51.684371+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:11.590555+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.327154+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:07.800589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:47:50.792 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:47:53.037 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:47:53.038 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":610,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:47:52.492590+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:33.422558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:52.583843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:12.764364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:32.277747+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.604077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:47:16.511873+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:31.760294+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:51.773158+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:11.590555+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:46:53.327154+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:07.800589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:47:56.594 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:47:58.856 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:47:58.857 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":613,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:47:55.489863+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:33.422558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:53.172865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:12.764364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:32.277747+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:54.484222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:47:16.511873+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:31.760294+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:51.773158+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:11.590555+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:53.392039+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:07.800589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:48:02.349 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:48:04.653 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:48:04.653 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":613,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:47:55.489863+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:33.422558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:53.172865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:12.764364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:32.277747+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:54.484222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:47:16.511873+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:31.760294+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:51.773158+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:11.590555+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:53.392039+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:07.800589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:48:08.147 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:48:10.312 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:48:10.312 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":614,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:48:07.922854+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:33.422558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:53.172865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:12.764364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:32.277747+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:54.484222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:47:16.511873+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:31.760294+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:51.773158+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:11.590555+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:53.392039+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:07.874083+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:48:13.829 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:48:16.154 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:48:16.154 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":617,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:48:13.513797+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:33.422558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:53.172865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:13.001468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:32.277747+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:54.484222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:47:16.511873+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:31.760294+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:51.773158+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:11.754976+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:53.392039+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:07.874083+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:48:19.699 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:48:21.881 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:48:21.882 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":619,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:48:20.502454+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:33.422558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:53.172865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:13.001468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:32.277747+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:54.484222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:48:16.761430+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:31.760294+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:51.773158+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:11.754976+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:53.392039+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:07.874083+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:48:25.409 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:48:27.678 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:48:27.679 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":619,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:48:20.502454+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:33.422558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:53.172865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:13.001468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:32.277747+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:54.484222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:48:16.761430+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:31.760294+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:51.773158+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:11.754976+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:53.392039+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:07.874083+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:48:31.180 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:48:33.433 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:48:33.433 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":620,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:48:32.517809+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:33.422558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:53.172865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:13.001468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:32.277747+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:54.484222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:48:16.761430+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:31.795724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:51.773158+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:11.754976+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:53.392039+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:07.874083+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:48:36.945 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:48:39.161 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:48:39.161 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":621,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:48:33.520899+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:33.500063+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:53.172865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:13.001468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:33.245834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:54.484222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:48:16.761430+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:31.795724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:51.773158+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:11.754976+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:53.392039+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:07.874083+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:48:42.661 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:48:44.868 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:48:44.868 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":621,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:48:33.520899+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:33.500063+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:53.172865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:13.001468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:33.245834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:54.484222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:48:16.761430+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:31.795724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:51.773158+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:11.754976+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:53.392039+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:07.874083+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:48:48.370 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:48:50.649 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:48:50.649 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":621,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:48:33.520899+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:33.500063+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:53.172865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:13.001468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:33.245834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:54.484222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:48:16.761430+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:31.795724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:51.773158+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:11.754976+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:47:53.392039+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:07.874083+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:48:54.128 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:48:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:48:56.390 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":625,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:48:55.520399+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:33.500063+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.284716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:13.001468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:33.245834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:54.500832+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:48:16.761430+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:31.795724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:51.805100+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:11.754976+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.907336+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:07.874083+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:48:59.913 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:49:02.159 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:49:02.160 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":625,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:48:55.520399+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:33.500063+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.284716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:13.001468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:33.245834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:54.500832+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:48:16.761430+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:31.795724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:51.805100+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:11.754976+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.907336+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:07.874083+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:49:05.704 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:49:07.960 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:49:07.960 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":625,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:48:55.520399+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:33.500063+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.284716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:13.001468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:33.245834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:54.500832+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:48:16.761430+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:31.795724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:51.805100+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:11.754976+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.907336+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:07.874083+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:49:11.467 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:49:13.785 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:49:13.785 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":629,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:49:13.542687+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:33.500063+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.284716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:13.455517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:33.245834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:54.500832+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:48:16.761430+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:31.795724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:51.805100+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:11.831974+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.907336+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:08.750337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:49:17.314 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:49:19.610 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:49:19.610 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":630,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:49:17.752710+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:33.500063+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.284716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:13.455517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:33.245834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:54.500832+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:49:17.701632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:31.795724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:51.805100+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:11.831974+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.907336+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:08.750337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:49:23.150 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:49:25.494 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:49:25.495 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":631,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:49:20.534034+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:33.500063+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.284716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:13.455517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:33.245834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:54.500832+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:49:17.701632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:31.795724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:51.805100+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:11.831974+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.907336+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:08.750337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:49:28.966 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:49:31.372 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:49:31.372 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":631,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:49:20.534034+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:33.500063+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.284716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:13.455517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:33.245834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:54.500832+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:49:17.701632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:31.795724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:51.805100+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:11.831974+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.907336+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:08.750337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:49:34.885 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:49:37.197 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:49:37.198 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":635,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:49:35.543164+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:34.253088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.284716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:13.455517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:33.359495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:54.500832+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:49:17.701632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:32.173470+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:51.805100+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:11.831974+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.907336+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:08.750337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:49:40.732 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:49:43.014 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:49:43.015 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":635,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:49:35.543164+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:34.253088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.284716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:13.455517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:33.359495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:54.500832+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:49:17.701632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:32.173470+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:51.805100+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:11.831974+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.907336+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:08.750337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:49:46.519 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:49:48.843 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:49:48.843 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":635,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:49:35.543164+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:34.253088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.284716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:13.455517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:33.359495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:54.500832+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:49:17.701632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:32.173470+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:51.805100+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:11.831974+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.907336+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:08.750337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:49:52.363 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:49:54.503 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:49:54.504 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":637,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:49:53.559220+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:34.253088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:53.487533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:13.455517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:33.359495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:54.500832+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:49:17.701632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:32.173470+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:52.481284+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:11.831974+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:48:53.907336+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:08.750337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:49:58.021 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:50:00.249 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:50:00.249 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":638,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:49:55.569269+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:34.253088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:53.487533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:13.455517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:33.359495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:54.978647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:49:17.701632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:32.173470+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:52.481284+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:11.831974+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:54.873291+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:08.750337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:50:03.755 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:50:06.025 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:50:06.025 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":639,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:50:00.554726+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:34.253088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:53.487533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:13.455517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:33.359495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:54.978647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:49:17.701632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:32.173470+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:52.481284+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:11.831974+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:54.873291+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:08.750337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:50:09.537 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:50:11.764 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:50:11.764 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":641,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:50:10.561295+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:34.253088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:53.487533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:13.455517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:33.359495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:54.978647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:49:17.701632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:32.173470+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:52.481284+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:11.831974+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:54.873291+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:08.935498+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:50:15.250 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:50:17.453 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:50:17.453 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":643,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:50:14.589147+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:34.253088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:53.487533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:14.421874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:33.359495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:54.978647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:49:17.701632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:32.173470+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:52.481284+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:11.846522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:54.873291+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:08.935498+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:50:20.944 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:50:23.078 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:50:23.079 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":645,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:50:20.565642+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:34.253088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:53.487533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:14.421874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:33.359495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:54.978647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:50:18.715879+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:32.173470+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:52.481284+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:11.846522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:54.873291+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:08.935498+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:50:26.608 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:50:28.869 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:50:28.869 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":645,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:50:20.565642+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:34.253088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:53.487533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:14.421874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:33.359495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:54.978647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:50:18.715879+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:32.173470+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:52.481284+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:11.846522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:54.873291+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:08.935498+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:50:32.357 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:50:34.490 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:50:34.490 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":646,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:50:32.576888+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:34.253088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:53.487533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:14.421874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:33.359495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:54.978647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:50:18.715879+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:32.188058+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:52.481284+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:11.846522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:54.873291+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:08.935498+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:50:37.992 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:50:40.226 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:50:40.226 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":648,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:50:35.596545+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:35.081357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:53.487533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:14.421874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:34.131408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:54.978647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:50:18.715879+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:32.188058+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:52.481284+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:11.846522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:54.873291+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:08.935498+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:50:43.756 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:50:45.926 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:50:45.926 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":649,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:50:40.575291+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:35.081357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:53.487533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:14.421874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:34.131408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:54.978647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:50:18.715879+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:32.188058+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:52.481284+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:11.846522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:54.873291+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:08.935498+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:50:49.467 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:50:51.693 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:50:51.693 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":649,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:50:40.575291+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:35.081357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:53.487533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:14.421874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:34.131408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:54.978647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:50:18.715879+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:32.188058+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:52.481284+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:11.846522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:49:54.873291+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:08.935498+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:50:55.192 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:50:57.499 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:50:57.499 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":652,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:50:55.611553+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:35.081357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.011580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:14.421874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:34.131408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:55.342595+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:50:18.715879+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:32.188058+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:53.284021+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:11.846522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.924729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:08.935498+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:51:01.015 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:51:03.278 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:51:03.278 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":653,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:51:00.586318+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:35.081357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.011580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:14.421874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:34.131408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:55.342595+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:50:18.715879+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:32.188058+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:53.284021+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:11.846522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.924729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:08.935498+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:51:06.759 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:51:09.009 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:51:09.009 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":653,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:51:00.586318+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:35.081357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.011580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:14.421874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:34.131408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:55.342595+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:50:18.715879+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:32.188058+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:53.284021+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:11.846522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.924729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:08.935498+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:51:12.554 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:51:14.783 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:51:14.784 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":657,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:51:14.612497+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:35.081357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.011580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:14.559182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:34.131408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:55.342595+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:50:18.715879+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:32.188058+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:53.284021+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:11.856927+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.924729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:09.063862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:51:18.303 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:51:20.560 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:51:20.561 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":658,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:51:19.739893+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:35.081357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.011580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:14.559182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:34.131408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:55.342595+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:51:18.800245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:32.188058+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:53.284021+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:11.856927+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.924729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:09.063862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:51:24.076 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:51:26.334 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:51:26.334 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":659,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:51:20.595692+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:35.081357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.011580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:14.559182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:34.131408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:55.342595+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:51:18.800245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:32.188058+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:53.284021+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:11.856927+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.924729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:09.063862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:51:29.844 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:51:32.170 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:51:32.171 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":659,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:51:20.595692+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:35.081357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.011580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:14.559182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:34.131408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:55.342595+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:51:18.800245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:32.188058+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:53.284021+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:11.856927+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.924729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:09.063862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:51:35.668 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:51:37.979 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:51:37.979 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":662,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:51:35.629468+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:35.253156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.011580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:14.559182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:34.164511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:55.342595+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:51:18.800245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:32.345972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:53.284021+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:11.856927+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.924729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:09.063862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:51:41.484 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:51:43.776 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:51:43.777 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":663,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:51:40.605252+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:35.253156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.011580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:14.559182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:34.164511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:55.342595+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:51:18.800245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:32.345972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:53.284021+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:11.856927+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.924729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:09.063862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:51:47.312 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:51:49.601 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:51:49.602 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":663,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:51:40.605252+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:35.253156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.011580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:14.559182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:34.164511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:55.342595+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:51:18.800245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:32.345972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:53.284021+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:11.856927+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.924729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:09.063862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:51:53.148 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:51:55.394 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:51:55.395 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":665,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:51:55.068523+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:35.253156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.014196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:14.559182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:34.164511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:55.342595+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:51:18.800245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:32.345972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.251208+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:11.856927+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:50:54.924729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:09.063862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:51:58.884 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:52:01.146 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:52:01.146 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":667,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:51:57.087687+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:35.253156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.014196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:14.559182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:34.164511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:56.281636+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:51:18.800245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:32.345972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.251208+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:11.856927+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:55.277691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:09.063862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:52:04.634 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:52:06.797 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:52:06.797 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":667,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:51:57.087687+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:35.253156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.014196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:14.559182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:34.164511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:56.281636+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:51:18.800245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:32.345972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.251208+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:11.856927+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:55.277691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:09.063862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:52:10.325 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:52:12.630 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:52:12.630 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":669,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:52:10.620415+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:35.253156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.014196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:14.559182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:34.164511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:56.281636+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:51:18.800245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:32.345972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.251208+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:11.856927+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:55.277691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:09.348189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:52:16.124 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:52:18.391 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:52:18.391 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":671,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:52:15.623330+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:35.253156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.014196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:14.866383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:34.164511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:56.281636+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:51:18.800245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:32.345972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.251208+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:12.547710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:55.277691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:09.348189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:52:21.900 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:52:24.148 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:52:24.149 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":673,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:52:20.625451+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:35.253156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.014196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:14.866383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:34.164511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:56.281636+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:52:19.033430+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:32.345972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.251208+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:12.547710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:55.277691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:09.348189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:52:27.629 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:52:29.922 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:52:29.922 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":673,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:52:20.625451+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:35.253156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.014196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:14.866383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:34.164511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:56.281636+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:52:19.033430+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:32.345972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.251208+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:12.547710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:55.277691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:09.348189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:52:33.438 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:52:35.712 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:52:35.713 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":675,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:52:34.647093+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:35.253156+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.014196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:14.866383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:34.172718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:56.281636+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:52:19.033430+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:32.430598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.251208+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:12.547710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:55.277691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:09.348189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:52:39.230 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:52:41.518 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:52:41.518 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":677,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:52:40.635564+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:36.206896+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.014196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:14.866383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:34.172718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:56.281636+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:52:19.033430+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:32.430598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.251208+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:12.547710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:55.277691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:09.348189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:52:45.040 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:52:47.271 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:52:47.271 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":677,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:52:40.635564+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:36.206896+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.014196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:14.866383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:34.172718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:56.281636+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:52:19.033430+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:32.430598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.251208+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:12.547710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:55.277691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:09.348189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:52:50.772 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:52:53.003 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:52:53.003 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":677,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:52:40.635564+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:36.206896+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.014196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:14.866383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:34.172718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:56.281636+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:52:19.033430+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:32.430598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:54.251208+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:12.547710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:51:55.277691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:09.348189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:52:56.565 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:52:58.748 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:52:58.748 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":680,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:52:57.776539+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:36.206896+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:54.358710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:14.866383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:34.172718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:57.138152+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:52:19.033430+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:32.430598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:54.481130+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:12.547710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:55.596672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:09.348189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:53:02.295 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:53:04.595 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:53:04.596 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":681,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:53:00.646239+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:36.206896+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:54.358710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:14.866383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:34.172718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:57.138152+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:52:19.033430+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:32.430598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:54.481130+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:12.547710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:55.596672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:09.348189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:53:08.077 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:53:10.382 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:53:10.382 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":682,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:53:10.234058+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:36.206896+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:54.358710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:14.866383+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:34.172718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:57.138152+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:52:19.033430+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:32.430598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:54.481130+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:12.547710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:55.596672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:10.185841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:53:13.956 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:53:16.084 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:53:16.085 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":685,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:53:15.658999+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:36.206896+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:54.358710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:15.363281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:34.172718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:57.138152+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:52:19.033430+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:32.430598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:54.481130+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:13.360256+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:55.596672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:10.185841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:53:19.596 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:53:21.875 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:53:21.875 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":686,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:53:20.766892+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:36.206896+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:54.358710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:15.363281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:34.172718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:57.138152+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:53:19.891017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:32.430598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:54.481130+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:13.360256+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:55.596672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:10.185841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:53:25.378 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:53:27.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:53:27.585 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":687,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:53:25.663527+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:36.206896+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:54.358710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:15.363281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:34.172718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:57.138152+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:53:19.891017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:32.430598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:54.481130+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:13.360256+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:55.596672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:10.185841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:53:31.119 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:53:33.355 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:53:33.355 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":687,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:53:25.663527+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:36.206896+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:54.358710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:15.363281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:34.172718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:57.138152+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:53:19.891017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:32.430598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:54.481130+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:13.360256+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:55.596672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:10.185841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:53:36.886 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:53:39.105 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:53:39.106 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":690,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:53:36.789856+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:36.376620+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:54.358710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:15.363281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:35.113709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:57.138152+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:53:19.891017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:33.269241+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:54.481130+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:13.360256+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:55.596672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:10.185841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:53:42.637 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:53:44.952 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:53:44.952 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":691,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:53:40.670997+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:36.376620+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:54.358710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:15.363281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:35.113709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:57.138152+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:53:19.891017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:33.269241+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:54.481130+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:13.360256+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:55.596672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:10.185841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:53:48.460 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:53:50.645 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:53:50.645 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":691,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:53:40.670997+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:36.376620+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:54.358710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:15.363281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:35.113709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:57.138152+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:53:19.891017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:33.269241+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:54.481130+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:13.360256+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:55.596672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:10.185841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:53:54.135 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:53:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:53:56.377 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":693,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:53:55.503898+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:36.376620+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:54.449774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:15.363281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:35.113709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:57.138152+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:53:19.891017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:33.269241+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.147523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:13.360256+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:52:55.596672+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:10.185841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:53:59.893 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:54:02.162 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:54:02.162 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":695,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:53:57.690712+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:36.376620+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:54.449774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:15.363281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:35.113709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:57.377100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:53:19.891017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:33.269241+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.147523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:13.360256+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.857357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:10.185841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:54:05.700 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:54:07.923 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:54:07.923 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":695,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:53:57.690712+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:36.376620+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:54.449774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:15.363281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:35.113709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:57.377100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:53:19.891017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:33.269241+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.147523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:13.360256+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.857357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:10.185841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:54:11.426 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:54:13.580 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:54:13.581 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":696,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:54:11.688992+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:36.376620+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:54.449774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:15.363281+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:35.113709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:57.377100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:53:19.891017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:33.269241+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.147523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:13.360256+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.857357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:11.146563+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:54:17.076 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:54:19.319 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:54:19.320 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":698,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:54:16.717121+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:36.376620+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:54.449774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:16.145606+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:35.113709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:57.377100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:53:19.891017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:33.269241+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.147523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:13.599228+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.857357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:11.146563+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:54:22.847 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:54:25.066 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:54:25.067 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":699,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:54:20.690355+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:36.376620+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:54.449774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:16.145606+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:35.113709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:57.377100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:54:20.076582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:33.269241+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.147523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:13.599228+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.857357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:11.146563+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:54:28.587 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:54:30.898 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:54:30.900 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":699,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:54:20.690355+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:36.376620+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:54.449774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:16.145606+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:35.113709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:57.377100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:54:20.076582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:33.269241+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.147523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:13.599228+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.857357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:11.146563+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:54:34.388 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:54:36.728 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:54:36.729 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":701,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:54:35.698240+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:36.376620+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:54.449774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:16.145606+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:35.113709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:57.377100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:54:20.076582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:33.566463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.147523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:13.599228+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.857357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:11.146563+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:54:40.248 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:54:42.450 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:54:42.450 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":703,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:54:37.812551+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:37.126013+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:54.449774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:16.145606+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:36.103193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:57.377100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:54:20.076582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:33.566463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.147523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:13.599228+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.857357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:11.146563+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:54:45.944 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:54:48.160 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:54:48.161 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":703,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:54:37.812551+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:37.126013+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:54.449774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:16.145606+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:36.103193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:57.377100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:54:20.076582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:33.566463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.147523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:13.599228+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.857357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:11.146563+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:54:51.677 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:54:53.965 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:54:53.965 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":703,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:54:37.812551+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:37.126013+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:54.449774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:16.145606+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:36.103193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:57.377100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:54:20.076582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:33.566463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.147523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:13.599228+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:53:55.857357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:11.146563+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:54:57.429 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:54:59.701 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:54:59.702 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":706,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:54:58.023835+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:37.126013+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:55.226973+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:16.145606+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:36.103193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:57.404241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:54:20.076582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:33.566463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.087141+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:13.599228+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.850556+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:11.146563+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:55:03.234 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:55:05.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:55:05.553 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":707,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:55:00.710699+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:37.126013+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:55.226973+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:16.145606+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:36.103193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:57.404241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:54:20.076582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:33.566463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.087141+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:13.599228+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.850556+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:11.146563+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:55:09.114 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:55:11.348 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:55:11.349 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":707,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:55:00.710699+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:37.126013+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:55.226973+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:16.145606+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:36.103193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:57.404241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:54:20.076582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:33.566463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.087141+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:13.599228+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.850556+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:11.146563+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:55:14.830 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:55:17.065 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:55:17.065 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":709,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:55:14.734111+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:37.126013+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:55.226973+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:16.145606+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:36.103193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:57.404241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:54:20.076582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:33.566463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.087141+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:14.585410+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.850556+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:11.315005+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:55:20.548 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:55:22.821 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:55:22.821 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":711,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:55:20.722086+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:37.126013+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:55.226973+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:17.057224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:36.103193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:57.404241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:55:20.534511+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:33.566463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.087141+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:14.585410+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.850556+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:11.315005+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:55:26.339 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:55:28.511 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:55:28.511 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":711,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:55:20.722086+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:37.126013+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:55.226973+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:17.057224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:36.103193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:57.404241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:55:20.534511+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:33.566463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.087141+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:14.585410+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.850556+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:11.315005+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:55:32.021 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:55:34.338 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:55:34.339 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":712,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:55:33.803578+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:37.126013+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:55.226973+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:17.057224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:36.103193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:57.404241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:55:20.534511+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:33.712713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.087141+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:14.585410+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.850556+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:11.315005+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:55:37.834 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:55:40.066 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:55:40.066 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":715,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:55:37.825875+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:37.271215+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:55.226973+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:17.057224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:36.288318+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:57.404241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:55:20.534511+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:33.712713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.087141+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:14.585410+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.850556+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:11.315005+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:55:43.566 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:55:45.700 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:55:45.700 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":715,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:55:37.825875+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:37.271215+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:55.226973+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:17.057224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:36.288318+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:57.404241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:55:20.534511+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:33.712713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.087141+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:14.585410+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.850556+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:11.315005+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:55:49.212 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:55:51.420 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:55:51.421 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":715,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:55:37.825875+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:37.271215+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:55.226973+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:17.057224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:36.288318+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:57.404241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:55:20.534511+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:33.712713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.087141+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:14.585410+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.850556+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:11.315005+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:55:54.911 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:55:57.065 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:55:57.065 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":716,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:55:56.811942+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:37.271215+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.043895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:17.057224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:36.288318+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:57.404241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:55:20.534511+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:33.712713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.201002+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:14.585410+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:54:56.850556+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:11.315005+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:56:00.544 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:56:02.832 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:56:02.833 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":717,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:55:57.819868+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:37.271215+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.043895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:17.057224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:36.288318+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:57.503627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:55:20.534511+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:33.712713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.201002+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:14.585410+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.980405+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:11.315005+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:56:06.347 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:56:08.665 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:56:08.665 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":717,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:55:57.819868+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:37.271215+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.043895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:17.057224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:36.288318+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:57.503627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:55:20.534511+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:33.712713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.201002+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:14.585410+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.980405+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:11.315005+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:56:12.181 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:56:14.356 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:56:14.356 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":718,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:56:12.752104+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:37.271215+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.043895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:17.057224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:36.288318+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:57.503627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:55:20.534511+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:33.712713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.201002+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:14.585410+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.980405+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:12.242605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:56:17.867 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:56:20.120 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:56:20.121 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":720,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:56:17.774662+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:37.271215+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.043895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:17.142813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:36.288318+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:57.503627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:55:20.534511+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:33.712713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.201002+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:14.830113+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.980405+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:12.242605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:56:23.641 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:56:25.942 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:56:25.942 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":723,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:56:25.755764+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:37.271215+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.043895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:17.142813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:36.288318+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:57.503627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:56:21.354602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:33.712713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.201002+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:14.830113+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.980405+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:12.242605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:56:29.491 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:56:31.710 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:56:31.711 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":723,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:56:25.755764+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:37.271215+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.043895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:17.142813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:36.288318+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:57.503627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:56:21.354602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:33.712713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.201002+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:14.830113+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.980405+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:12.242605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:56:35.197 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:56:37.420 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:56:37.421 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":725,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:56:35.762075+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:37.271215+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.043895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:17.142813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:36.288318+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:57.503627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:56:21.354602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:34.483274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.201002+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:14.830113+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.980405+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:12.242605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:56:40.914 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:56:43.139 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:56:43.139 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":727,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:56:38.784086+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:37.995227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.043895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:17.142813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:37.302120+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:57.503627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:56:21.354602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:34.483274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.201002+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:14.830113+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.980405+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:12.242605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:56:46.653 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:56:49.028 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:56:49.028 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":727,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:56:38.784086+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:37.995227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.043895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:17.142813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:37.302120+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:57.503627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:56:21.354602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:34.483274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.201002+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:14.830113+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.980405+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:12.242605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:56:52.581 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:56:54.855 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:56:54.856 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":727,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:56:38.784086+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:37.995227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.043895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:17.142813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:37.302120+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:57.503627+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:56:21.354602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:34.483274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.201002+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:14.830113+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:55:56.980405+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:12.242605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:56:58.342 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:57:00.565 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:57:00.565 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":729,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:56:58.829151+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:37.995227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:56.956766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:17.142813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:37.302120+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:58.423176+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:56:21.354602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:34.483274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:56.872696+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:14.830113+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:57.446879+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:12.242605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:57:04.061 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:57:06.260 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:57:06.260 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":729,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:56:58.829151+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:37.995227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:56.956766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:17.142813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:37.302120+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:58.423176+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:56:21.354602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:34.483274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:56.872696+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:14.830113+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:57.446879+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:12.242605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:57:09.761 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:57:12.098 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:57:12.099 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":729,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:56:58.829151+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:37.995227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:56.956766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:17.142813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:37.302120+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:58.423176+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:56:21.354602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:34.483274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:56.872696+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:14.830113+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:57.446879+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:12.242605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:57:15.612 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:57:17.868 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:57:17.869 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":731,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:57:15.783271+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:37.995227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:56.956766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:17.142813+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:37.302120+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:58.423176+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:56:21.354602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:34.483274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:56.872696+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:15.622875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:57.446879+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:13.131405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:57:21.344 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:57:23.645 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:57:23.646 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":734,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:57:22.376294+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:37.995227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:56.956766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:17.272304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:37.302120+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:58.423176+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:57:22.176740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:34.483274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:56.872696+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:15.622875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:57.446879+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:13.131405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:57:27.125 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:57:29.369 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:57:29.369 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":735,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:57:25.787833+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:37.995227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:56.956766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:17.272304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:37.302120+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:58.423176+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:57:22.176740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:34.483274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:56.872696+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:15.622875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:57.446879+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:13.131405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:57:32.890 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:57:35.156 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:57:35.157 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":735,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:57:25.787833+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:37.995227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:56.956766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:17.272304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:37.302120+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:58.423176+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:57:22.176740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:34.483274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:56.872696+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:15.622875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:57.446879+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:13.131405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:57:38.665 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:57:40.881 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:57:40.882 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":739,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:57:40.796249+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:38.155611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:56.956766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:17.272304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:37.671553+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:58.423176+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:57:22.176740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:35.430951+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:56.872696+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:15.622875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:57.446879+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:13.131405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:57:44.381 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:57:46.670 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:57:46.670 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":739,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:57:40.796249+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:38.155611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:56.956766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:17.272304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:37.671553+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:58.423176+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:57:22.176740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:35.430951+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:56.872696+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:15.622875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:57.446879+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:13.131405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:57:50.190 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:57:52.383 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:57:52.383 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":739,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:57:40.796249+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:38.155611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:56.956766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:17.272304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:37.671553+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:58.423176+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:57:22.176740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:35.430951+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:56.872696+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:15.622875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:57.446879+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:13.131405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:57:55.933 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:57:58.060 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:57:58.060 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":740,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:57:57.838078+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:38.155611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.821582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:17.272304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:37.671553+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:58.423176+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:57:22.176740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:35.430951+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.693611+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:15.622875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:56:57.446879+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:13.131405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:58:01.569 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:58:03.831 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:58:03.831 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":741,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:57:58.840782+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:38.155611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.821582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:17.272304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:37.671553+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:58.509801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:57:22.176740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:35.430951+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.693611+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:15.622875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:58.047762+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:13.131405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:58:07.320 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:58:09.619 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:58:09.620 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":741,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:57:58.840782+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:38.155611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.821582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:17.272304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:37.671553+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:58.509801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:57:22.176740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:35.430951+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.693611+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:15.622875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:58.047762+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:13.131405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:58:13.095 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:58:15.369 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:58:15.369 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":742,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:58:14.002944+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:38.155611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.821582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:17.272304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:37.671553+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:58.509801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:57:22.176740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:35.430951+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.693611+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:15.622875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:58.047762+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:13.956511+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:58:18.876 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:58:21.100 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:58:21.100 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":745,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:58:18.827291+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:38.155611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.821582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:18.177185+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:37.671553+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:58.509801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:57:22.176740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:35.430951+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.693611+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:15.841071+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:58.047762+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:13.956511+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:58:24.629 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:58:26.930 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:58:26.930 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":747,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:58:25.818519+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:38.155611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.821582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:18.177185+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:37.671553+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:58.509801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:58:22.967350+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:35.430951+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.693611+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:15.841071+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:58.047762+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:13.956511+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:58:30.458 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:58:32.682 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:58:32.682 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":747,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:58:25.818519+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:38.155611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.821582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:18.177185+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:37.671553+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:58.509801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:58:22.967350+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:35.430951+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.693611+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:15.841071+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:58.047762+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:13.956511+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:58:36.197 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:58:38.423 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:58:38.424 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":749,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:58:37.970294+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:38.155611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.821582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:18.177185+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:37.919408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:58.509801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:58:22.967350+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:35.777006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.693611+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:15.841071+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:58.047762+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:13.956511+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:58:41.924 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:58:44.216 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:58:44.216 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":751,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:58:40.826327+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:38.210495+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.821582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:18.177185+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:37.919408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:58.509801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:58:22.967350+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:35.777006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.693611+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:15.841071+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:58.047762+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:13.956511+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:58:47.697 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:58:49.907 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:58:49.908 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":751,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:58:40.826327+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:38.210495+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.821582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:18.177185+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:37.919408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:58.509801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:58:22.967350+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:35.777006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.693611+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:15.841071+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:58.047762+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:13.956511+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:58:53.436 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:58:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:58:55.615 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":751,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:58:40.826327+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:38.210495+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.821582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:18.177185+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:37.919408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:58.509801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:58:22.967350+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:35.777006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:57.693611+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:15.841071+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:57:58.047762+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:13.956511+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:58:59.150 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:59:01.426 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:59:01.427 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":753,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:58:59.246519+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:38.210495+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.696434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:18.177185+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:37.919408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:59.024170+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:58:22.967350+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:35.777006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.195506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:15.841071+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.363296+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:13.956511+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:59:04.954 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:59:07.248 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:59:07.249 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":753,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:58:59.246519+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:38.210495+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.696434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:18.177185+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:37.919408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:59.024170+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:58:22.967350+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:35.777006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.195506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:15.841071+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.363296+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:13.956511+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:59:10.745 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:59:12.995 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:59:12.995 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":753,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:58:59.246519+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:38.210495+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.696434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:18.177185+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:37.919408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:59.024170+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:58:22.967350+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:35.777006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.195506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:15.841071+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.363296+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:13.956511+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:59:16.484 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:59:18.826 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:59:18.826 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":756,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:59:16.865587+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:38.210495+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.696434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:18.177185+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:37.919408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:59.024170+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:58:22.967350+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:35.777006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.195506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:16.758907+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.363296+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:14.146028+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:59:22.359 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:59:24.646 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:59:24.646 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":758,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:59:23.851509+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:38.210495+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.696434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:19.117554+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:37.919408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:59.024170+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:59:23.253783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:35.777006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.195506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:16.758907+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.363296+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:14.146028+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:59:28.134 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:59:30.451 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:59:30.452 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":759,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:59:25.852842+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:38.210495+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.696434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:19.117554+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:37.919408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:59.024170+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:59:23.253783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:35.777006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.195506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:16.758907+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.363296+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:14.146028+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:59:33.960 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:59:36.237 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:59:36.238 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":761,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:59:35.861725+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:38.210495+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.696434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:19.117554+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:37.919408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:59.024170+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:59:23.253783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:35.823220+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.195506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:16.758907+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.363296+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:14.146028+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:59:39.818 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:59:42.057 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:59:42.057 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":763,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:59:39.164234+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.453414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.696434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:19.117554+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.110258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:59.024170+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:59:23.253783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:35.823220+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.195506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:16.758907+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.363296+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:14.146028+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:59:45.576 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:59:47.890 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:59:47.891 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":763,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:59:39.164234+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.453414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.696434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:19.117554+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.110258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:59.024170+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:59:23.253783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:35.823220+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.195506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:16.758907+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.363296+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:14.146028+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:59:51.384 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:59:53.604 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:59:53.604 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":763,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:59:39.164234+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.453414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.696434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:19.117554+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.110258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:59.024170+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:59:23.253783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:35.823220+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.195506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:16.758907+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.363296+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:14.146028+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T22:59:57.093 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T22:59:59.302 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T22:59:59.302 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":764,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:59:58.424493+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.453414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.696434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:19.117554+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.110258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:59.024170+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:59:23.253783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:35.823220+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:58:58.195506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:16.758907+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.378963+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:14.146028+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:00:02.841 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:00:05.047 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:00:05.048 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":765,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:59:59.427771+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.453414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.982770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:19.117554+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.110258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:59.306144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:59:23.253783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:35.823220+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.502443+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:16.758907+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.378963+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:14.146028+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:00:08.546 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:00:10.825 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:00:10.825 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":765,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T22:59:59.427771+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.453414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.982770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:19.117554+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.110258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:59.306144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:59:23.253783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:35.823220+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.502443+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:16.758907+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.378963+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:14.146028+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:00:14.350 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:00:16.582 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:00:16.583 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":767,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:00:15.881254+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.453414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.982770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:19.117554+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.110258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:59.306144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:59:23.253783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:35.823220+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.502443+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:16.758907+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.378963+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:14.307311+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:00:20.062 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:00:22.291 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:00:22.292 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":769,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:00:20.170865+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.453414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.982770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:20.119929+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.110258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:59.306144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T22:59:23.253783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:35.823220+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.502443+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:17.621292+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.378963+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:14.307311+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:00:25.819 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:00:28.059 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:00:28.059 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":771,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:00:25.885717+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.453414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.982770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:20.119929+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.110258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:59.306144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:00:24.209764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:35.823220+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.502443+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:17.621292+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.378963+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:14.307311+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:00:31.554 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:00:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:00:33.823 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":771,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:00:25.885717+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.453414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.982770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:20.119929+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.110258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:59.306144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:00:24.209764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:35.823220+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.502443+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:17.621292+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.378963+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:14.307311+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:00:37.325 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:00:39.490 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:00:39.490 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":773,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:00:38.905415+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:38.513064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.982770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:20.119929+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:38.110258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:59.306144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:00:24.209764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:36.425345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.502443+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:17.621292+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.378963+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:14.307311+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:00:42.973 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:00:45.192 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:00:45.192 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":775,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:00:40.893353+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:38.513064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.982770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:20.119929+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:39.072808+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:59.306144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:00:24.209764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:36.425345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.502443+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:17.621292+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.378963+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:14.307311+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:00:48.713 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:00:50.881 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:00:50.882 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":775,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:00:40.893353+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:38.513064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.982770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:20.119929+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:39.072808+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:59.306144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:00:24.209764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:36.425345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.502443+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:17.621292+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.378963+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:14.307311+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:00:54.389 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:00:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:00:56.740 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":775,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:00:40.893353+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:38.513064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.982770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:20.119929+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:39.072808+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:59.306144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:00:24.209764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:36.425345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.502443+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:17.621292+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:59:58.378963+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:14.307311+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:01:00.256 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:01:02.574 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:01:02.574 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":777,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:01:00.902771+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:38.513064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.055429+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:20.119929+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:39.072808+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.483130+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:00:24.209764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:36.425345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.351246+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:17.621292+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.108360+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:14.307311+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:01:06.088 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:01:08.303 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:01:08.303 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":777,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:01:00.902771+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:38.513064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.055429+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:20.119929+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:39.072808+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.483130+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:00:24.209764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:36.425345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.351246+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:17.621292+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.108360+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:14.307311+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:01:11.860 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:01:14.051 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:01:14.052 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":777,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:01:00.902771+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:38.513064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.055429+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:20.119929+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:39.072808+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.483130+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:00:24.209764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:36.425345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.351246+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:17.621292+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.108360+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:14.307311+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:01:17.534 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:01:19.756 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:01:19.756 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":780,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:01:18.178393+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:38.513064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.055429+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:20.119929+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:39.072808+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.483130+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:00:24.209764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:36.425345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.351246+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:18.133679+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.108360+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:14.537321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:01:23.266 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:01:25.478 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:01:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":782,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:01:21.924907+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:38.513064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.055429+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:21.115807+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:39.072808+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.483130+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:00:24.209764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:36.425345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.351246+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:18.133679+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.108360+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:14.537321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:01:28.995 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:01:31.522 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:01:31.523 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":783,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:01:25.879660+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:38.513064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.055429+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:21.115807+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:39.072808+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.483130+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:01:25.135715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:36.425345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.351246+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:18.133679+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.108360+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:14.537321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:01:35.070 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:01:37.364 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:01:37.364 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":784,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:01:36.923050+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:38.513064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.055429+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:21.115807+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:39.072808+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.483130+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:01:25.135715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:36.468872+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.351246+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:18.133679+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.108360+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:14.537321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:01:40.875 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:01:43.088 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:01:43.088 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":787,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:01:40.921770+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:38.840348+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.055429+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:21.115807+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:39.153285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.483130+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:01:25.135715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:36.468872+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.351246+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:18.133679+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.108360+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:14.537321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:01:46.619 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:01:48.873 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:01:48.874 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":787,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:01:40.921770+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:38.840348+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.055429+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:21.115807+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:39.153285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.483130+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:01:25.135715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:36.468872+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.351246+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:18.133679+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.108360+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:14.537321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:01:52.366 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:01:54.615 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:01:54.615 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":787,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:01:40.921770+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:38.840348+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.055429+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:21.115807+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:39.153285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.483130+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:01:25.135715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:36.468872+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.351246+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:18.133679+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:00:59.108360+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:14.537321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:01:58.125 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:02:00.491 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:02:00.492 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":788,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:01:59.890991+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:38.840348+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.874798+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:21.115807+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:39.153285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.704954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:01:25.135715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:36.468872+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.495165+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:18.133679+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.718609+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:14.537321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:02:03.966 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:02:06.286 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:02:06.286 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":789,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:02:00.930609+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:38.840348+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.874798+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:21.115807+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:39.153285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.704954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:01:25.135715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:36.468872+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.495165+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:18.133679+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.718609+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:14.537321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:02:09.808 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:02:12.061 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:02:12.062 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":789,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:02:00.930609+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:38.840348+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.874798+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:21.115807+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:39.153285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.704954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:01:25.135715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:36.468872+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.495165+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:18.133679+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.718609+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:14.537321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:02:15.583 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:02:17.758 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:02:17.758 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":791,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:02:15.937649+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:38.840348+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.874798+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:21.115807+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:39.153285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.704954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:01:25.135715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:36.468872+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.495165+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:18.133679+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.718609+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:14.641605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:02:21.308 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:02:23.545 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:02:23.546 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":794,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:02:21.965341+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:38.840348+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.874798+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:21.934775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:39.153285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.704954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:01:25.135715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:36.468872+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.495165+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:19.130620+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.718609+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:14.641605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:02:27.058 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:02:29.323 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:02:29.323 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":795,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:02:25.943308+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:38.840348+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.874798+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:21.934775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:39.153285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.704954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:02:25.435841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:36.468872+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.495165+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:19.130620+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.718609+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:14.641605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:02:32.855 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:02:35.002 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:02:35.002 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":795,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:02:25.943308+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:38.840348+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.874798+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:21.934775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:39.153285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.704954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:02:25.435841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:36.468872+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.495165+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:19.130620+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.718609+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:14.641605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:02:38.573 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:02:40.894 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:02:40.895 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":797,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:02:39.965421+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.830864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.874798+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:21.934775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.359565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.704954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:02:25.435841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:37.479330+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.495165+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:19.130620+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.718609+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:14.641605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:02:44.443 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:02:46.694 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:02:46.694 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":797,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:02:39.965421+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.830864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.874798+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:21.934775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.359565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.704954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:02:25.435841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:37.479330+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.495165+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:19.130620+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.718609+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:14.641605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:02:50.230 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:02:52.494 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:02:52.494 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":797,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:02:39.965421+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.830864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.874798+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:21.934775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.359565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.704954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:02:25.435841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:37.479330+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.495165+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:19.130620+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.718609+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:14.641605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:02:56.039 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:02:58.336 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:02:58.337 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":797,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:02:39.965421+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.830864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.874798+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:21.934775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.359565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.704954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:02:25.435841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:37.479330+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.495165+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:19.130620+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:01:59.718609+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:14.641605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:03:01.805 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:03:04.076 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:03:04.076 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":799,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:03:00.959955+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.830864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.122038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:21.934775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.359565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.316642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:02:25.435841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:37.479330+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:59.901592+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:19.130620+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.012675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:14.641605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:03:07.588 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:03:09.880 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:03:09.880 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":799,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:03:00.959955+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.830864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.122038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:21.934775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.359565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.316642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:02:25.435841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:37.479330+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:59.901592+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:19.130620+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.012675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:14.641605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:03:13.413 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:03:15.688 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:03:15.688 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":799,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:03:00.959955+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.830864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.122038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:21.934775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.359565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.316642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:02:25.435841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:37.479330+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:59.901592+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:19.130620+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.012675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:14.641605+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:03:19.170 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:03:21.473 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:03:21.473 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":803,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:03:20.970430+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.830864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.122038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:21.934775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.359565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.316642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:02:25.435841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:37.479330+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:59.901592+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:19.830311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.012675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:15.530810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:03:24.996 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:03:27.258 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:03:27.259 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":805,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:03:25.972825+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.830864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.122038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:22.319946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.359565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.316642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:03:25.460861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:37.479330+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:59.901592+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:19.830311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.012675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:15.530810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:03:30.777 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:03:33.018 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:03:33.018 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":805,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:03:25.972825+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.830864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.122038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:22.319946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.359565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.316642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:03:25.460861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:37.479330+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:59.901592+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:19.830311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.012675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:15.530810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:03:36.512 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:03:38.716 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:03:38.716 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":806,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:03:38.160574+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.830864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.122038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:22.319946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:39.359565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.316642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:03:25.460861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:38.112523+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:59.901592+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:19.830311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.012675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:15.530810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:03:42.174 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:03:44.450 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:03:44.451 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":807,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:03:40.172199+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:39.932696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.122038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:22.319946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:39.390783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.316642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:03:25.460861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:38.112523+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:59.901592+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:19.830311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.012675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:15.530810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:03:47.908 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:03:50.115 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:03:50.115 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":807,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:03:40.172199+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:39.932696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.122038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:22.319946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:39.390783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.316642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:03:25.460861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:38.112523+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:59.901592+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:19.830311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.012675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:15.530810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:03:53.592 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:03:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:03:55.851 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":807,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:03:40.172199+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:39.932696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.122038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:22.319946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:39.390783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.316642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:03:25.460861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:38.112523+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:02:59.901592+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:19.830311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.012675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:15.530810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:03:59.411 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:04:01.642 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:04:01.642 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":809,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:04:00.989858+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:39.932696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.132245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:22.319946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:39.390783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:00.316642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:03:25.460861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:38.112523+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.146439+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:19.830311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.202046+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:15.530810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:04:05.153 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:04:07.512 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:04:07.513 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":811,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:04:05.993988+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:39.932696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.132245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:22.319946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:39.390783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:01.054854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:03:25.460861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:38.112523+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.146439+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:19.830311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.202046+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:15.530810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:04:11.025 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:04:13.300 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:04:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":811,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:04:05.993988+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:39.932696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.132245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:22.319946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:39.390783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:01.054854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:03:25.460861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:38.112523+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.146439+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:19.830311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.202046+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:15.530810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:04:16.797 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:04:19.026 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:04:19.026 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":812,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:04:17.010660+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:39.932696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.132245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:22.319946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:39.390783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:01.054854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:03:25.460861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:38.112523+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.146439+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:19.830311+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.202046+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:16.431737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:04:22.539 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:04:24.781 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:04:24.782 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":814,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:04:23.007556+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:39.932696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.132245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:22.529967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:39.390783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:01.054854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:03:25.460861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:38.112523+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.146439+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:20.780962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.202046+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:16.431737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:04:28.295 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:04:30.564 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:04:30.565 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":816,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:04:27.029588+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:39.932696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.132245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:22.529967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:39.390783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:01.054854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:04:26.253860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:38.112523+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.146439+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:20.780962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.202046+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:16.431737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:04:34.069 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:04:36.302 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:04:36.302 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":817,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:04:31.006923+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:39.932696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.132245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:22.529967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:39.390783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:01.054854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:04:26.253860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:03:38.112523+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.146439+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:20.780962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.202046+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:16.431737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:04:39.855 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:04:42.127 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:04:42.127 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":821,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:04:41.011627+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:40.120226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.132245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:22.529967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:39.716897+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:01.054854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:04:26.253860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:38.820355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.146439+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:20.780962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.202046+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:16.431737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:04:45.620 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:04:47.900 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:04:47.900 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":821,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:04:41.011627+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:40.120226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.132245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:22.529967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:39.716897+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:01.054854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:04:26.253860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:38.820355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.146439+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:20.780962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.202046+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:16.431737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:04:51.353 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:04:53.693 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:04:53.694 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":821,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:04:41.011627+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:40.120226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.132245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:22.529967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:39.716897+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:01.054854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:04:26.253860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:38.820355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.146439+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:20.780962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.202046+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:16.431737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:04:57.236 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:04:59.574 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:04:59.574 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":821,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:04:41.011627+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:40.120226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.132245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:22.529967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:39.716897+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:01.054854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:04:26.253860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:38.820355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.146439+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:20.780962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:00.202046+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:16.431737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:05:03.082 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:05:05.400 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:05:05.400 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":824,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:05:02.029742+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:40.120226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:00.760446+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:22.529967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:39.716897+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:01.555408+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:04:26.253860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:38.820355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:00.952513+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:20.780962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:01.073458+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:16.431737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:05:08.899 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:05:11.117 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:05:11.118 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":825,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:05:06.023281+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:40.120226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:00.760446+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:22.529967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:39.716897+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:01.555408+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:04:26.253860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:38.820355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:00.952513+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:20.780962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:01.073458+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:16.431737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:05:14.599 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:05:16.846 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:05:16.846 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":825,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:05:06.023281+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:40.120226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:00.760446+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:22.529967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:39.716897+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:01.555408+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:04:26.253860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:38.820355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:00.952513+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:20.780962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:01.073458+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:16.431737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:05:20.377 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:05:22.589 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:05:22.589 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":828,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:05:22.455784+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:40.120226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:00.760446+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:22.529967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:39.716897+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:01.555408+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:04:26.253860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:38.820355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:00.952513+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:21.546996+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:01.073458+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:17.133507+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:05:26.066 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:05:28.358 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:05:28.358 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":830,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:05:27.042268+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:40.120226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:00.760446+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:23.137153+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:39.716897+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:01.555408+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:05:26.423834+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:38.820355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:00.952513+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:21.546996+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:01.073458+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:17.133507+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:05:31.856 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:05:34.118 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:05:34.119 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":831,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:05:31.036528+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:40.120226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:00.760446+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:23.137153+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:39.716897+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:01.555408+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:05:26.423834+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:38.820355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:00.952513+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:21.546996+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:01.073458+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:17.133507+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:05:37.682 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:05:39.935 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:05:39.936 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":831,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:05:31.036528+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:40.120226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:00.760446+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:23.137153+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:39.716897+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:01.555408+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:05:26.423834+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:04:38.820355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:00.952513+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:21.546996+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:01.073458+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:17.133507+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:05:43.503 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:05:45.711 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:05:45.712 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":834,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:05:41.957160+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:41.026002+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:00.760446+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:23.137153+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:40.441005+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:01.555408+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:05:26.423834+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:39.710785+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:00.952513+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:21.546996+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:01.073458+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:17.133507+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:05:49.203 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:05:51.442 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:05:51.442 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":835,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:05:46.043238+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:41.026002+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:00.760446+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:23.137153+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:40.441005+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:01.555408+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:05:26.423834+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:39.710785+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:00.952513+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:21.546996+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:01.073458+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:17.133507+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:05:54.937 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:05:57.167 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:05:57.167 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":835,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:05:46.043238+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:41.026002+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:00.760446+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:23.137153+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:40.441005+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:01.555408+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:05:26.423834+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:39.710785+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:00.952513+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:21.546996+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:01.073458+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:17.133507+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:06:00.661 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:06:02.967 INFO:teuthology.orchestra.run.smithi037.stderr:2019-12-24T23:06:02.952+0000 7f5341c7f700 0 --2- 172.21.15.37:0/2745475718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f533c065e40 0x7f533c066270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-24T23:06:03.178 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:06:03.179 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":838,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:06:02.063412+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:41.026002+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:00.772791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:23.137153+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:40.441005+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.998895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:05:26.423834+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:39.710785+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.276361+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:21.546996+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.387621+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:17.133507+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:06:06.731 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:06:09.047 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:06:09.047 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":839,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:06:06.053221+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:41.026002+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:00.772791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:23.137153+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:40.441005+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.998895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:05:26.423834+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:39.710785+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.276361+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:21.546996+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.387621+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:17.133507+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:06:12.598 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:06:14.868 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:06:14.869 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":839,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:06:06.053221+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:41.026002+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:00.772791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:23.137153+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:40.441005+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.998895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:05:26.423834+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:39.710785+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.276361+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:21.546996+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.387621+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:17.133507+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:06:18.376 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:06:20.604 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:06:20.605 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":840,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:06:18.069804+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:41.026002+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:00.772791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:23.137153+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:40.441005+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.998895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:05:26.423834+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:39.710785+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.276361+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:21.546996+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.387621+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:17.150532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:06:24.116 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:06:26.408 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:06:26.409 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":843,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:06:24.473574+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:41.026002+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:00.772791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:23.869508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:40.441005+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.998895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:05:26.423834+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:39.710785+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.276361+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:21.946791+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.387621+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:17.150532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:06:29.892 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:06:32.186 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:06:32.186 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":845,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:06:31.065583+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:41.026002+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:00.772791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:23.869508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:40.441005+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.998895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:06:27.231260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:39.710785+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.276361+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:21.946791+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.387621+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:17.150532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:06:35.720 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:06:37.928 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:06:37.929 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":845,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:06:31.065583+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:41.026002+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:00.772791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:23.869508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:40.441005+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.998895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:06:27.231260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:05:39.710785+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.276361+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:21.946791+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.387621+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:17.150532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:06:41.442 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:06:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:06:43.598 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":848,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:06:42.085360+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.218632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:00.772791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:23.869508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.012615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.998895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:06:27.231260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:40.670239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.276361+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:21.946791+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.387621+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:17.150532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:06:47.095 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:06:49.354 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:06:49.354 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":849,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:06:46.074974+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.218632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:00.772791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:23.869508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.012615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.998895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:06:27.231260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:40.670239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.276361+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:21.946791+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.387621+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:17.150532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:06:52.852 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:06:55.077 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:06:55.077 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":849,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:06:46.074974+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.218632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:00.772791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:23.869508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.012615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.998895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:06:27.231260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:40.670239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.276361+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:21.946791+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.387621+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:17.150532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:06:58.602 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:07:00.871 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:07:00.871 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":849,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:06:46.074974+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.218632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:00.772791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:23.869508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.012615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.998895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:06:27.231260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:40.670239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.276361+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:21.946791+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:01.387621+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:17.150532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:07:04.371 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:07:06.680 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:07:06.681 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":851,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:07:02.958971+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.218632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:00.970928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:23.869508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.012615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:02.115107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:06:27.231260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:40.670239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:02.069064+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:21.946791+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:01.419819+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:17.150532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:07:10.169 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:07:12.375 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:07:12.375 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":851,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:07:02.958971+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.218632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:00.970928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:23.869508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.012615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:02.115107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:06:27.231260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:40.670239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:02.069064+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:21.946791+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:01.419819+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:17.150532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:07:15.887 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:07:18.139 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:07:18.139 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":851,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:07:02.958971+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.218632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:00.970928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:23.869508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.012615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:02.115107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:06:27.231260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:40.670239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:02.069064+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:21.946791+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:01.419819+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:17.150532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:07:21.693 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:07:23.905 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:07:23.905 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":854,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:07:23.099730+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.218632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:00.970928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:23.869508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.012615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:02.115107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:06:27.231260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:40.670239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:02.069064+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:22.124404+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:01.419819+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:18.114687+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:07:27.433 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:07:29.715 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:07:29.715 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":856,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:07:28.128512+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.218632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:00.970928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:24.086970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.012615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:02.115107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:07:27.611466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:40.670239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:02.069064+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:22.124404+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:01.419819+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:18.114687+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:07:33.240 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:07:35.548 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:07:35.549 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":857,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:07:31.097772+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.218632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:00.970928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:24.086970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.012615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:02.115107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:07:27.611466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:40.670239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:02.069064+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:22.124404+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:01.419819+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:18.114687+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:07:39.113 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:07:41.391 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:07:41.391 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":859,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:07:41.103480+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.218632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:00.970928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:24.086970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:06:41.012615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:02.115107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:07:27.611466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:40.674452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:02.069064+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:22.124404+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:01.419819+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:18.114687+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:07:44.911 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:07:47.206 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:07:47.206 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":861,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:07:46.107301+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:41.385287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:00.970928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:24.086970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:41.401803+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:02.115107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:07:27.611466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:40.674452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:02.069064+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:22.124404+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:01.419819+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:18.114687+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:07:50.738 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:07:52.993 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:07:52.993 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":861,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:07:46.107301+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:41.385287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:00.970928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:24.086970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:41.401803+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:02.115107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:07:27.611466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:40.674452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:02.069064+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:22.124404+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:01.419819+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:18.114687+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:07:56.518 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:07:58.987 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:07:58.988 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":861,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:07:46.107301+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:41.385287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:00.970928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:24.086970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:41.401803+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:02.115107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:07:27.611466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:40.674452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:02.069064+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:22.124404+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:01.419819+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:18.114687+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:08:02.516 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:08:04.816 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:08:04.816 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":864,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:08:03.986004+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:41.385287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:01.027128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:24.086970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:41.401803+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:03.015250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:07:27.611466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:40.674452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.299296+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:22.124404+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.083357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:18.114687+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:08:08.326 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:08:10.547 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:08:10.547 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":865,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:08:06.116159+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:41.385287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:01.027128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:24.086970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:41.401803+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:03.015250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:07:27.611466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:40.674452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.299296+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:22.124404+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.083357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:18.114687+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:08:14.057 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:08:16.344 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:08:16.345 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":865,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:08:06.116159+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:41.385287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:01.027128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:24.086970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:41.401803+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:03.015250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:07:27.611466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:40.674452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.299296+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:22.124404+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.083357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:18.114687+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:08:19.851 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:08:22.066 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:08:22.067 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":867,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:08:21.122934+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:41.385287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:01.027128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:24.086970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:41.401803+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:03.015250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:07:27.611466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:40.674452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.299296+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:22.124404+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.083357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:18.521032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:08:25.532 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:08:27.823 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:08:27.823 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":869,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:08:25.140424+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:41.385287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:01.027128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:24.159372+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:41.401803+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:03.015250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:07:27.611466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:40.674452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.299296+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:23.080485+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.083357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:18.521032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:08:31.299 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:08:33.546 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:08:33.546 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":871,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:08:31.128514+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:41.385287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:01.027128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:24.159372+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:41.401803+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:03.015250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:08:27.865790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:40.674452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.299296+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:23.080485+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.083357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:18.521032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:08:37.027 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:08:39.271 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:08:39.271 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":871,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:08:31.128514+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:41.385287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:01.027128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:24.159372+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:41.401803+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:03.015250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:08:27.865790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:07:40.674452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.299296+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:23.080485+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.083357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:18.521032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:08:42.744 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:08:44.909 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:08:44.909 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":874,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:08:42.143867+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.575290+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:01.027128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:24.159372+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.498321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:03.015250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:08:27.865790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:40.923994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.299296+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:23.080485+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.083357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:18.521032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:08:48.408 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:08:50.580 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:08:50.580 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":875,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:08:46.136339+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.575290+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:01.027128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:24.159372+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.498321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:03.015250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:08:27.865790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:40.923994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.299296+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:23.080485+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.083357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:18.521032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:08:54.096 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:08:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:08:56.225 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":875,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:08:46.136339+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.575290+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:01.027128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:24.159372+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.498321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:03.015250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:08:27.865790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:40.923994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.299296+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:23.080485+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.083357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:18.521032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:08:59.730 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:09:01.963 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:09:01.964 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":875,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:08:46.136339+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.575290+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:01.027128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:24.159372+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.498321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:03.015250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:08:27.865790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:40.923994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.299296+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:23.080485+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:02.083357+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:18.521032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:09:05.479 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:09:07.846 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:09:07.846 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":879,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:09:06.147136+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.575290+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:01.138861+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:24.159372+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.498321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:03.936212+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:08:27.865790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:40.923994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:03.240276+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:23.080485+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:02.130824+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:18.521032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:09:11.352 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:09:13.635 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:09:13.636 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":879,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:09:06.147136+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.575290+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:01.138861+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:24.159372+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.498321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:03.936212+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:08:27.865790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:40.923994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:03.240276+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:23.080485+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:02.130824+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:18.521032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:09:17.104 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:09:19.247 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:09:19.247 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":879,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:09:06.147136+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.575290+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:01.138861+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:24.159372+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.498321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:03.936212+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:08:27.865790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:40.923994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:03.240276+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:23.080485+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:02.130824+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:18.521032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:09:22.725 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:09:25.023 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:09:25.023 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":882,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:09:24.169152+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.575290+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:01.138861+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:24.159372+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.498321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:03.936212+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:08:27.865790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:40.923994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:03.240276+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:24.013320+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:02.130824+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:19.461482+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:09:28.570 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:09:30.807 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:09:30.808 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":884,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:09:28.183674+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.575290+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:01.138861+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:24.933525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.498321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:03.936212+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:09:27.979070+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:40.923994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:03.240276+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:24.013320+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:02.130824+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:19.461482+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:09:34.332 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:09:36.495 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:09:36.495 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":885,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:09:31.159765+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.575290+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:01.138861+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:24.933525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.498321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:03.936212+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:09:27.979070+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:40.923994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:03.240276+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:24.013320+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:02.130824+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:19.461482+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:09:39.988 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:09:42.161 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:09:42.162 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":887,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:09:41.164978+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.575290+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:01.138861+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:24.933525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:08:41.498321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:03.936212+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:09:27.979070+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:40.968200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:03.240276+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:24.013320+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:02.130824+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:19.461482+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:09:45.659 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:09:47.912 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:09:47.913 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":889,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:09:46.169475+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:41.642147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:01.138861+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:24.933525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:41.501223+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:03.936212+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:09:27.979070+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:40.968200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:03.240276+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:24.013320+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:02.130824+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:19.461482+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:09:51.460 INFO:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 4a02c23c-2698-11ea-8286-001a4aab830c -- ceph osd dump --format=json 2019-12-24T23:09:53.679 INFO:teuthology.orchestra.run.smithi037.stdout: 2019-12-24T23:09:53.680 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":889,"fsid":"4a02c23c-2698-11ea-8286-001a4aab830c","created":"2019-12-24T21:57:38.639659+0000","modified":"2019-12-24T23:09:46.169475+0000","last_up_change":"2019-12-24T22:07:49.181890+0000","last_in_change":"2019-12-24T22:07:32.194762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c799ce4a-3bc5-41f4-8204-14b2dcdaebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1},{"type":"v1","addr":"172.21.15.37:6803","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1},{"type":"v1","addr":"172.21.15.37:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1},{"type":"v1","addr":"172.21.15.37:6809","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1},{"type":"v1","addr":"172.21.15.37:6807","nonce":1}]},"public_addr":"172.21.15.37:6803/1","cluster_addr":"172.21.15.37:6805/1","heartbeat_back_addr":"172.21.15.37:6809/1","heartbeat_front_addr":"172.21.15.37:6807/1","state":["exists","up"]},{"osd":1,"uuid":"916a5b5f-cf2b-46be-89f6-fdba5a7c0209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1},{"type":"v1","addr":"172.21.15.37:6811","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1},{"type":"v1","addr":"172.21.15.37:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1},{"type":"v1","addr":"172.21.15.37:6817","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1},{"type":"v1","addr":"172.21.15.37:6815","nonce":1}]},"public_addr":"172.21.15.37:6811/1","cluster_addr":"172.21.15.37:6813/1","heartbeat_back_addr":"172.21.15.37:6817/1","heartbeat_front_addr":"172.21.15.37:6815/1","state":["exists","up"]},{"osd":2,"uuid":"419d02f1-c9b3-417b-ba4d-b58349a58904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1},{"type":"v1","addr":"172.21.15.37:6819","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1},{"type":"v1","addr":"172.21.15.37:6821","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1},{"type":"v1","addr":"172.21.15.37:6825","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1},{"type":"v1","addr":"172.21.15.37:6823","nonce":1}]},"public_addr":"172.21.15.37:6819/1","cluster_addr":"172.21.15.37:6821/1","heartbeat_back_addr":"172.21.15.37:6825/1","heartbeat_front_addr":"172.21.15.37:6823/1","state":["exists","up"]},{"osd":3,"uuid":"9836824f-ba9f-4f57-b1b1-102518a6bd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1},{"type":"v1","addr":"172.21.15.37:6827","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1},{"type":"v1","addr":"172.21.15.37:6829","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1},{"type":"v1","addr":"172.21.15.37:6833","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1},{"type":"v1","addr":"172.21.15.37:6831","nonce":1}]},"public_addr":"172.21.15.37:6827/1","cluster_addr":"172.21.15.37:6829/1","heartbeat_back_addr":"172.21.15.37:6833/1","heartbeat_front_addr":"172.21.15.37:6831/1","state":["exists","up"]},{"osd":4,"uuid":"8362ed26-8b70-4b97-a76c-35b6d0d1baad","up":1,"in":1,"weight":0.474700927734375,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1},{"type":"v1","addr":"172.21.15.6:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1},{"type":"v1","addr":"172.21.15.6:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1},{"type":"v1","addr":"172.21.15.6:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1},{"type":"v1","addr":"172.21.15.6:6805","nonce":1}]},"public_addr":"172.21.15.6:6801/1","cluster_addr":"172.21.15.6:6803/1","heartbeat_back_addr":"172.21.15.6:6807/1","heartbeat_front_addr":"172.21.15.6:6805/1","state":["exists","up"]},{"osd":5,"uuid":"61719885-3438-45cb-9d5e-9a6f2597cd07","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1},{"type":"v1","addr":"172.21.15.6:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1},{"type":"v1","addr":"172.21.15.6:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1},{"type":"v1","addr":"172.21.15.6:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1},{"type":"v1","addr":"172.21.15.6:6813","nonce":1}]},"public_addr":"172.21.15.6:6809/1","cluster_addr":"172.21.15.6:6811/1","heartbeat_back_addr":"172.21.15.6:6815/1","heartbeat_front_addr":"172.21.15.6:6813/1","state":["exists","up"]},{"osd":6,"uuid":"4d49e020-db19-42d8-8488-434ef5fc294a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1},{"type":"v1","addr":"172.21.15.6:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1},{"type":"v1","addr":"172.21.15.6:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1},{"type":"v1","addr":"172.21.15.6:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1},{"type":"v1","addr":"172.21.15.6:6821","nonce":1}]},"public_addr":"172.21.15.6:6817/1","cluster_addr":"172.21.15.6:6819/1","heartbeat_back_addr":"172.21.15.6:6823/1","heartbeat_front_addr":"172.21.15.6:6821/1","state":["exists","up"]},{"osd":7,"uuid":"15d86808-448c-4422-863c-8a1e7c63f269","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1},{"type":"v1","addr":"172.21.15.6:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1},{"type":"v1","addr":"172.21.15.6:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1},{"type":"v1","addr":"172.21.15.6:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1},{"type":"v1","addr":"172.21.15.6:6829","nonce":1}]},"public_addr":"172.21.15.6:6825/1","cluster_addr":"172.21.15.6:6827/1","heartbeat_back_addr":"172.21.15.6:6831/1","heartbeat_front_addr":"172.21.15.6:6829/1","state":["exists","up"]},{"osd":8,"uuid":"1220ae5a-8f30-4fa2-89dc-6fcd1b90f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1},{"type":"v1","addr":"172.21.15.124:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1},{"type":"v1","addr":"172.21.15.124:6803","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1},{"type":"v1","addr":"172.21.15.124:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1},{"type":"v1","addr":"172.21.15.124:6805","nonce":1}]},"public_addr":"172.21.15.124:6801/1","cluster_addr":"172.21.15.124:6803/1","heartbeat_back_addr":"172.21.15.124:6807/1","heartbeat_front_addr":"172.21.15.124:6805/1","state":["exists","up"]},{"osd":9,"uuid":"b0793d47-cd8b-465c-83ae-505462844757","up":0,"in":1,"weight":1,"primary_affinity":0.128204345703125,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":96,"down_at":115,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1},{"type":"v1","addr":"172.21.15.124:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1},{"type":"v1","addr":"172.21.15.124:6811","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1},{"type":"v1","addr":"172.21.15.124:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1},{"type":"v1","addr":"172.21.15.124:6813","nonce":1}]},"public_addr":"172.21.15.124:6809/1","cluster_addr":"172.21.15.124:6811/1","heartbeat_back_addr":"172.21.15.124:6815/1","heartbeat_front_addr":"172.21.15.124:6813/1","state":["exists"]},{"osd":10,"uuid":"053340b7-e591-4649-af97-917c0e99b0a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":1},{"type":"v1","addr":"172.21.15.124:6817","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":1},{"type":"v1","addr":"172.21.15.124:6819","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":1},{"type":"v1","addr":"172.21.15.124:6823","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":1},{"type":"v1","addr":"172.21.15.124:6821","nonce":1}]},"public_addr":"172.21.15.124:6817/1","cluster_addr":"172.21.15.124:6819/1","heartbeat_back_addr":"172.21.15.124:6823/1","heartbeat_front_addr":"172.21.15.124:6821/1","state":["exists","up"]},{"osd":11,"uuid":"05ace7ae-7d6a-43dc-a444-9958ec67e9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":1},{"type":"v1","addr":"172.21.15.124:6825","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":1},{"type":"v1","addr":"172.21.15.124:6827","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":1},{"type":"v1","addr":"172.21.15.124:6831","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":1},{"type":"v1","addr":"172.21.15.124:6829","nonce":1}]},"public_addr":"172.21.15.124:6825/1","cluster_addr":"172.21.15.124:6827/1","heartbeat_back_addr":"172.21.15.124:6831/1","heartbeat_front_addr":"172.21.15.124:6829/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:41.642147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:01.138861+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:24.933525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:41.501223+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:03.936212+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2019-12-24T23:09:27.979070+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:40.968200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:03.240276+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:24.013320+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T22:07:12.479513+0000","dead_epoch":115},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:02.130824+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-24T23:09:19.461482+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.37:6801/1":"2019-12-25T21:57:55.699433+0000","172.21.15.37:6800/1":"2019-12-25T21:57:55.699433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-24T23:09:56.966 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2019-12-24T23:09:56.966 DEBUG:teuthology.task.console_log:Killing console logger for smithi124 2019-12-24T23:09:56.966 DEBUG:teuthology.task.console_log:Killing console logger for smithi006 2019-12-24T23:09:56.967 DEBUG:teuthology.task.console_log:Killing console logger for smithi037 2019-12-24T23:09:56.967 DEBUG:teuthology.task.console_log:Killing console logger for smithi124 2019-12-24T23:09:56.967 DEBUG:teuthology.task.console_log:Killing console logger for smithi006 2019-12-24T23:09:56.968 DEBUG:teuthology.task.console_log:Killing console logger for smithi037 2019-12-24T23:09:56.968 DEBUG:teuthology.exit:Finished running handlers